2025-12-02 08:00:25 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-02 08:00:25 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-02 08:00:25 [manheim.gb] INFO: Starting spider manheim.gb
2025-12-02 08:00:25 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-02 08:00:25 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-02 08:00:25 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-02 08:00:25 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-02 08:00:25 [scrapy.extensions.telnet] INFO: Telnet Password: 80cd6b086129a97c
2025-12-02 08:00:26 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2025-12-02 08:00:26 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/manheim.gb/task_37_2025-12-02T08_00_03.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2025-12-02 08:00:26 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-02 08:00:26 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-02 08:00:26 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-02 08:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-02 08:00:26 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-02 08:00:26 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2025-12-02 08:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:00:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:00:26 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-02 08:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-02 08:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:00:26 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-02 08:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-02 08:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-02 08:00:26 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-02 08:00:26 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-02 08:00:26 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-02 08:00:26 [scrapy.core.engine] INFO: Spider opened
2025-12-02 08:00:26 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-02 08:00:26 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2025-12-02 08:00:26 [scrapy-playwright] INFO: Starting download handler
2025-12-02 08:00:26 [scrapy-playwright] INFO: Starting download handler
2025-12-02 08:00:31 [scrapy-playwright] INFO: Launching browser firefox
2025-12-02 08:00:32 [scrapy-playwright] INFO: Browser firefox launched
2025-12-02 08:00:32 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2025-12-02 08:00:34 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2025-12-02 08:00:34 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-02 08:00:34 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://www.manheim.co.uk/>
2025-12-02 08:00:34 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-02 08:00:35 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/>
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1>
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-02 08:00:36 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/buying-options/buying-options-c153-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/buying-options/buying-options-c153-treated--hero.ashx?la=en&mw=1920>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/manheimcolchester10.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/manheimcolchester10.ashx?la=en&mw=1920>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-02 08:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-02 08:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-02 08:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918385017&visitor_id_sign=84f4557d5a7a074c785b583a07be676de820e792b17534b3b50babe03db8ac8ca087532bb72d0f4b74b5d5d3fcd9bf9e043c3165&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918385017&visitor_id_sign=84f4557d5a7a074c785b583a07be676de820e792b17534b3b50babe03db8ac8ca087532bb72d0f4b74b5d5d3fcd9bf9e043c3165&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-02 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/account/login> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:48 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/account/login> (location: /mymanheim/dashboard)
2025-12-02 08:00:48 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/mymanheim/dashboard> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:49 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/mymanheim/dashboard>
2025-12-02 08:00:49 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:49 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/SignalR/Hubs> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/myManheim.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/dashboards.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/SignalR/Hubs>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/myManheim.css>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/dashboards.css>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (location: https://www.manheim.co.uk/404)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/404> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <404 https://www.manheim.co.uk/404>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-02 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (location: https://www.manheim.co.uk/404)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/404> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Response: <404 https://www.manheim.co.uk/404>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif>
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-02 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-02 08:00:52 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:52 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:52 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-02 08:00:52 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-02 08:00:52 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:52 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-02 08:00:52 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-02 08:00:52 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=918385017&visitor_id_sign=84f4557d5a7a074c785b583a07be676de820e792b17534b3b50babe03db8ac8ca087532bb72d0f4b74b5d5d3fcd9bf9e043c3165&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:53 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=918385017&visitor_id_sign=84f4557d5a7a074c785b583a07be676de820e792b17534b3b50babe03db8ac8ca087532bb72d0f4b74b5d5d3fcd9bf9e043c3165&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-02 08:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918385017&visitor_id_sign=84f4557d5a7a074c785b583a07be676de820e792b17534b3b50babe03db8ac8ca087532bb72d0f4b74b5d5d3fcd9bf9e043c3165&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-02 08:00:53 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918385017&visitor_id_sign=84f4557d5a7a074c785b583a07be676de820e792b17534b3b50babe03db8ac8ca087532bb72d0f4b74b5d5d3fcd9bf9e043c3165&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-02 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk> (referer: None) ['playwright']
2025-12-02 08:00:57 [manheim.gb] INFO: Cookies from Playwright: [{'name': 'ASP.NET_SessionId', 'value': 'figjgrgvthsbcxhm42bc3xuo', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'Lax'}, {'name': '__RequestVerificationToken', 'value': 'a5aMGc8Osqsw3aUI-M_hLcNR4SCTEWQmkeGJ2VRo9XvQjCb69X7eJafv_X8mGPmZib9WmQHCLxCmlFUOmfsqnsUvEZA1', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796198436, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'remarketing-web', 'value': '066C30CC9A49051700F1CC91DD0B08239A1EC5DEB300E1A93B791F6D2F36814C959708DF193A8EECC2560DE2E0DD4F42F4684E29AA06A9DB4E40C5125FFCAA5D6DA0AC4AEF14AEBE7242716AA988E8C40FBC09090D69C3ECBA85ADA29DFC08AC543587CE1A266F76DA6597ACC07236F222542764', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918385017', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796198453, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': '84f4557d5a7a074c785b583a07be676de820e792b17534b3b50babe03db8ac8ca087532bb72d0f4b74b5d5d3fcd9bf9e043c3165', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796198453, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918385017', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796198453, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': '84f4557d5a7a074c785b583a07be676de820e792b17534b3b50babe03db8ac8ca087532bb72d0f4b74b5d5d3fcd9bf9e043c3165', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796198453, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918385017', 'domain': '.pardot.com', 'path': '/', 'expires': 1796198453, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': '84f4557d5a7a074c785b583a07be676de820e792b17534b3b50babe03db8ac8ca087532bb72d0f4b74b5d5d3fcd9bf9e043c3165', 'domain': '.pardot.com', 'path': '/', 'expires': 1796198453, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/', 'expires': 1764664253, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2025-12-02 08:00:57 [manheim.gb] INFO: Scrapy-formatted cookies: [{'name': 'ASP.NET_SessionId', 'value': 'figjgrgvthsbcxhm42bc3xuo', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': '__RequestVerificationToken', 'value': 'a5aMGc8Osqsw3aUI-M_hLcNR4SCTEWQmkeGJ2VRo9XvQjCb69X7eJafv_X8mGPmZib9WmQHCLxCmlFUOmfsqnsUvEZA1', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'remarketing-web', 'value': '066C30CC9A49051700F1CC91DD0B08239A1EC5DEB300E1A93B791F6D2F36814C959708DF193A8EECC2560DE2E0DD4F42F4684E29AA06A9DB4E40C5125FFCAA5D6DA0AC4AEF14AEBE7242716AA988E8C40FBC09090D69C3ECBA85ADA29DFC08AC543587CE1A266F76DA6597ACC07236F222542764', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918385017', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': '84f4557d5a7a074c785b583a07be676de820e792b17534b3b50babe03db8ac8ca087532bb72d0f4b74b5d5d3fcd9bf9e043c3165', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918385017', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': '84f4557d5a7a074c785b583a07be676de820e792b17534b3b50babe03db8ac8ca087532bb72d0f4b74b5d5d3fcd9bf9e043c3165', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918385017', 'domain': '.pardot.com', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': '84f4557d5a7a074c785b583a07be676de820e792b17534b3b50babe03db8ac8ca087532bb72d0f4b74b5d5d3fcd9bf9e043c3165', 'domain': '.pardot.com', 'path': '/'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/'}]
2025-12-02 08:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Manheim',RowKey='cookies') HTTP/1.1" 204 0
2025-12-02 08:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-02 08:00:59 [manheim.gb] INFO: Found listing with ID: 1019262
2025-12-02 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271019262%27 HTTP/1.1" 200 None
2025-12-02 08:00:59 [manheim.gb] INFO: Scrape type for 1019262: 0
2025-12-02 08:00:59 [manheim.gb] INFO: Found listing with ID: 1078284
2025-12-02 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271078284%27 HTTP/1.1" 200 None
2025-12-02 08:00:59 [manheim.gb] INFO: Scrape type for 1078284: 0
2025-12-02 08:00:59 [manheim.gb] INFO: Found listing with ID: 1089633
2025-12-02 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271089633%27 HTTP/1.1" 200 None
2025-12-02 08:00:59 [manheim.gb] INFO: Scrape type for 1089633: 1
2025-12-02 08:00:59 [manheim.gb] INFO: Found listing with ID: 1104811
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271104811%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1104811: 1
2025-12-02 08:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1127441
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271127441%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1127441: 1
2025-12-02 08:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1153610
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271153610%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1153610: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1162585
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271162585%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1162585: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1167549
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271167549%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1167549: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1173100
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271173100%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1173100: 1
2025-12-02 08:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1191100
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271191100%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1191100: 2
2025-12-02 08:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1195824
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271195824%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1195824: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 124569
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27124569%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 124569: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1271730
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271271730%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1271730: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1281726
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271281726%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1281726: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1306828
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271306828%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1306828: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1314291
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271314291%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1314291: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1317459
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271317459%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1317459: 1
2025-12-02 08:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1359028
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271359028%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1359028: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1361733
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271361733%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1361733: 1
2025-12-02 08:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1403363
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271403363%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1403363: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1418917
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271418917%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1418917: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1473959
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271473959%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1473959: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1479833
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271479833%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1479833: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1484153
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271484153%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1484153: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1485199
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271485199%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1485199: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 149524
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27149524%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 149524: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1501704
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271501704%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1501704: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1541191
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271541191%27 HTTP/1.1" 200 None
2025-12-02 08:01:00 [manheim.gb] INFO: Scrape type for 1541191: 0
2025-12-02 08:01:00 [manheim.gb] INFO: Found listing with ID: 1546758
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271546758%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1546758: 1
2025-12-02 08:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1554861
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271554861%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1554861: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1563459
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271563459%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1563459: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1580164
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271580164%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1580164: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1623130
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271623130%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1623130: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1639320
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271639320%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1639320: 1
2025-12-02 08:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1645141
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271645141%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1645141: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1667102
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271667102%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1667102: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1671760
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271671760%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1671760: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1691148
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271691148%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1691148: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1701386
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271701386%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1701386: 1
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1736358
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271736358%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1736358: 1
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1762778
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271762778%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1762778: 1
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1787313
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271787313%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1787313: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1798612
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271798612%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1798612: 1
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1825401
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271825401%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1825401: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1835329
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271835329%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1835329: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1847472
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271847472%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1847472: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1856076
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271856076%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1856076: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1856565
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271856565%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1856565: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1859294
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271859294%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1859294: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1864706
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271864706%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1864706: 1
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1894788
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271894788%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1894788: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1900706
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271900706%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1900706: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1905242
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271905242%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1905242: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1940423
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271940423%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1940423: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1950952
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271950952%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1950952: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1962040
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271962040%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1962040: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1989821
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271989821%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1989821: 1
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 1995165
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271995165%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 1995165: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 2014140
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272014140%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 2014140: 1
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 2022887
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272022887%27 HTTP/1.1" 200 None
2025-12-02 08:01:01 [manheim.gb] INFO: Scrape type for 2022887: 0
2025-12-02 08:01:01 [manheim.gb] INFO: Found listing with ID: 2044428
2025-12-02 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272044428%27 HTTP/1.1" 200 None
2025-12-02 08:01:02 [manheim.gb] INFO: Scrape type for 2044428: 1
2025-12-02 08:01:02 [manheim.gb] INFO: Found listing with ID: 2057516
2025-12-02 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272057516%27 HTTP/1.1" 200 None
2025-12-02 08:01:02 [manheim.gb] INFO: Scrape type for 2057516: 1
2025-12-02 08:01:02 [manheim.gb] INFO: Found listing with ID: 2058572
2025-12-02 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272058572%27 HTTP/1.1" 200 None
2025-12-02 08:01:02 [manheim.gb] INFO: Scrape type for 2058572: 1
2025-12-02 08:01:02 [manheim.gb] INFO: Found listing with ID: 2075642
2025-12-02 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272075642%27 HTTP/1.1" 200 None
2025-12-02 08:01:02 [manheim.gb] INFO: Scrape type for 2075642: 0
2025-12-02 08:01:02 [manheim.gb] INFO: Found listing with ID: 2091777
2025-12-02 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272091777%27 HTTP/1.1" 200 None
2025-12-02 08:01:02 [manheim.gb] INFO: Scrape type for 2091777: 1
2025-12-02 08:01:02 [manheim.gb] INFO: Found listing with ID: 2093385
2025-12-02 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272093385%27 HTTP/1.1" 200 None
2025-12-02 08:01:02 [manheim.gb] INFO: Scrape type for 2093385: 0
2025-12-02 08:01:02 [manheim.gb] INFO: Found listing with ID: 2143331
2025-12-02 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272143331%27 HTTP/1.1" 200 None
2025-12-02 08:01:02 [manheim.gb] INFO: Scrape type for 2143331: 1
2025-12-02 08:01:02 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 08:01:02 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 08:01:02 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 08:01:02 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 08:01:02 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 08:01:03 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 08:01:03 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 08:01:03 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search)
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
yield await it.__anext__()
^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
async for item_or_request in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
scraped_item = self._extract_listing_item(item, expiration_date)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
item["odometer"] = odometer
~~~~^^^^^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-02 08:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=1089633&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231089633&indx=5> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:01:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a04e308-c753-5b7d-89c8-d047b0e6ac8b with identifier: 1089633
2025-12-02 08:01:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:01:26 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 3 pages/min), scraped 0 items (at 0 items/min)
2025-12-02 08:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=1191100&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231191100&indx=15> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c09971d2-0f86-5121-95df-3a46bf4d998a with identifier: 1191100
2025-12-02 08:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c09971d2-0f86-5121-95df-3a46bf4d998a with scrape type 2
2025-12-02 08:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c09971d2-0f86-5121-95df-3a46bf4d998a with scrape type 2
2025-12-02 08:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: c09971d2-0f86-5121-95df-3a46bf4d998a, identifier: 1191100
2025-12-02 08:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: c09971d2-0f86-5121-95df-3a46bf4d998a with identifier: 1191100
2025-12-02 08:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 08:01:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY HTTP/1.1" 200 None
2025-12-02 08:01:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 08:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 08:01:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2025-12-02 08:01:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 08:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: c09971d2-0f86-5121-95df-3a46bf4d998a with identifier: 1191100
2025-12-02 08:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: c09971d2-0f86-5121-95df-3a46bf4d998a with identifier: 1191100 to the API
2025-12-02 08:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 08:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 08:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=1191100&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231191100&indx=15>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001191100-01960557-005.pdf',
'color': 'GREY',
'currency': 'GBP',
'engine': '1.2L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Petrol',
'id': 'c09971d2-0f86-5121-95df-3a46bf4d998a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YN66YKL',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=1191100',
'listing': 'auction',
'location': 'Colchester',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 73214,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-02',
'seller_name': 'Startline Motor Finance',
'title': 'PEUGEOT 2008 1.2 PureTech Allure 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech Allure 5dr',
'year': 2016}
2025-12-02 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271191100%27 HTTP/1.1" 200 None
2025-12-02 08:01:27 [manheim.gb] INFO: Saving data for 1191100: {'auction_closing_time': 1764838800.0, 'created_time': 1762459321.585089, 'last_price_update_time': 1764662487.879807}
2025-12-02 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1191100') HTTP/1.1" 204 0
2025-12-02 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/3SERIES?id=1317459&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231317459&indx=23> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf> (referer: None)
2025-12-02 08:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22959678-4c66-5fb6-9bf6-12e1cd091a9f with identifier: 1317459
2025-12-02 08:01:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a242690>
2025-12-02 08:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_expert_report_file_a93caff6-1265-46d8-93f2-17eb453d05a8.pdf HTTP/1.1" 201 0
2025-12-02 08:01:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:01:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a04e308-c753-5b7d-89c8-d047b0e6ac8b, skipping ID generation
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_7.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_7.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_6.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_1.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_5.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_4.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_11.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_10.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_9.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_2.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_5.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_3.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_4.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1089633-4003813-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-13.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1089633-4003813-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1000.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1089633-4003813-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1001.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1089633-4003813-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1002.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1089633-4003813-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1003.jpg not downloaded yet
2025-12-02 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1089633-4003813-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1004.jpg not downloaded yet
2025-12-02 08:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1089633-4003813-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1005.jpg not downloaded yet
2025-12-02 08:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/PASSAT?id=1127441&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231127441&indx=9> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5be135ec-c9fe-55f1-b809-f70ed7ffc818 with identifier: 1127441
2025-12-02 08:01:33 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MINI/PACEMAN?id=1173100&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231173100&indx=14> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6 with identifier: 1173100
2025-12-02 08:01:33 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf> (referer: None)
2025-12-02 08:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a205790>
2025-12-02 08:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_expert_report_file_d627aaf6-978d-4ca1-936d-5d4d17294945.pdf HTTP/1.1" 201 0
2025-12-02 08:01:34 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5be135ec-c9fe-55f1-b809-f70ed7ffc818, skipping ID generation
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg not downloaded yet
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg not downloaded yet
2025-12-02 08:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MINI/CLUBMAN?id=1104811&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231104811&indx=7> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_6.jpg not downloaded yet
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_1.jpg not downloaded yet
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_5.jpg not downloaded yet
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_4.jpg not downloaded yet
2025-12-02 08:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_11.jpg not downloaded yet
2025-12-02 08:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da26166-d7d0-5af2-a580-8a7fdcc24325 with identifier: 1104811
2025-12-02 08:01:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_10.jpg not downloaded yet
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_9.jpg not downloaded yet
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_2.jpg not downloaded yet
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_5.jpg not downloaded yet
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_3.jpg not downloaded yet
2025-12-02 08:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792bf0d0>
2025-12-02 08:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1089633-4003813-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1005.jpg saved to cache
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_4.jpg not downloaded yet
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1127441-4003109-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-13.jpg not downloaded yet
2025-12-02 08:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1127441-4003109-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1000.jpg not downloaded yet
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1127441-4003109-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1001.jpg not downloaded yet
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1127441-4003109-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1002.jpg not downloaded yet
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1127441-4003109-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1003.jpg not downloaded yet
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1127441-4003109-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1004.jpg not downloaded yet
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1127441-4003109-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1005.jpg not downloaded yet
2025-12-02 08:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379213350>
2025-12-02 08:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg saved to cache
2025-12-02 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf> (referer: None)
2025-12-02 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792d5310>
2025-12-02 08:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1127441-4003109-13.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-13.jpg saved to cache
2025-12-02 08:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792c9090>
2025-12-02 08:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_expert_report_file_e794dc25-5648-4ac9-b04c-6ce483a9d586.pdf HTTP/1.1" 201 0
2025-12-02 08:01:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6, skipping ID generation
2025-12-02 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_7.jpg not downloaded yet
2025-12-02 08:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a5ec1d0>
2025-12-02 08:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_4.jpg saved to cache
2025-12-02 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_7.jpg not downloaded yet
2025-12-02 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_6.jpg not downloaded yet
2025-12-02 08:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637926a350>
2025-12-02 08:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1127441-4003109-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1003.jpg saved to cache
2025-12-02 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_1.jpg not downloaded yet
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_5.jpg not downloaded yet
2025-12-02 08:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_4.jpg not downloaded yet
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378931e90>
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1127441-4003109-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1005.jpg saved to cache
2025-12-02 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637893fad0>
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1127441-4003109-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1004.jpg saved to cache
2025-12-02 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_11.jpg not downloaded yet
2025-12-02 08:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/5SERIES?id=1361733&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231361733&indx=26> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_10.jpg not downloaded yet
2025-12-02 08:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637893d050>
2025-12-02 08:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_7.jpg saved to cache
2025-12-02 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637895e410>
2025-12-02 08:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1127441-4003109-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1002.jpg saved to cache
2025-12-02 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_9.jpg not downloaded yet
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_2.jpg not downloaded yet
2025-12-02 08:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc73f181-d6c9-544f-a94c-2aa8cb39ae74 with identifier: 1361733
2025-12-02 08:01:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2416d0>
2025-12-02 08:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_7.jpg saved to cache
2025-12-02 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_5.jpg not downloaded yet
2025-12-02 08:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_3.jpg not downloaded yet
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_4.jpg not downloaded yet
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1173100-4004079-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-13.jpg not downloaded yet
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1173100-4004079-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1000.jpg not downloaded yet
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1173100-4004079-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1001.jpg not downloaded yet
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3aa3d0>
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_5.jpg saved to cache
2025-12-02 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2069d0>
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_4.jpg saved to cache
2025-12-02 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1173100-4004079-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1002.jpg not downloaded yet
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792bf7d0>
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_11.jpg saved to cache
2025-12-02 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1173100-4004079-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1003.jpg not downloaded yet
2025-12-02 08:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1173100-4004079-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1004.jpg not downloaded yet
2025-12-02 08:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1173100-4004079-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1005.jpg not downloaded yet
2025-12-02 08:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf> (referer: None)
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a5ec290>
2025-12-02 08:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_1.jpg saved to cache
2025-12-02 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378942410>
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_5.jpg saved to cache
2025-12-02 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637895c050>
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_2.jpg saved to cache
2025-12-02 08:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637898b590>
2025-12-02 08:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_expert_report_file_26923bd9-0235-4362-8146-948fda953a54.pdf HTTP/1.1" 201 0
2025-12-02 08:01:41 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc73f181-d6c9-544f-a94c-2aa8cb39ae74, skipping ID generation
2025-12-02 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_7.jpg not downloaded yet
2025-12-02 08:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_7.jpg not downloaded yet
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_6.jpg not downloaded yet
2025-12-02 08:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_1.jpg not downloaded yet
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_5.jpg not downloaded yet
2025-12-02 08:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379211950>
2025-12-02 08:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1173100-4004079-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1002.jpg saved to cache
2025-12-02 08:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0c0110>
2025-12-02 08:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1173100-4004079-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1004.jpg saved to cache
2025-12-02 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_4.jpg not downloaded yet
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_11.jpg not downloaded yet
2025-12-02 08:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/HYUNDAI/I20?id=1546758&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231546758&indx=40> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_10.jpg not downloaded yet
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379ba3b50>
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1173100-4004079-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1003.jpg saved to cache
2025-12-02 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a085390>
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1173100-4004079-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1005.jpg saved to cache
2025-12-02 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_9.jpg not downloaded yet
2025-12-02 08:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_2.jpg not downloaded yet
2025-12-02 08:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 165c7016-28ee-5501-9051-16d20a9d3c9a with identifier: 1546758
2025-12-02 08:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 165c7016-28ee-5501-9051-16d20a9d3c9a
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63789285d0>
2025-12-02 08:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_7.jpg saved to cache
2025-12-02 08:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_5.jpg not downloaded yet
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_3.jpg not downloaded yet
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_4.jpg not downloaded yet
2025-12-02 08:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637891f910>
2025-12-02 08:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1173100-4004079-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1001.jpg saved to cache
2025-12-02 08:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a00f3d0>
2025-12-02 08:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_4.jpg saved to cache
2025-12-02 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a009190>
2025-12-02 08:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_5.jpg saved to cache
2025-12-02 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1361733-4003248-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-13.jpg not downloaded yet
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1361733-4003248-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1000.jpg not downloaded yet
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1361733-4003248-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1001.jpg not downloaded yet
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1361733-4003248-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1002.jpg not downloaded yet
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1361733-4003248-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1003.jpg not downloaded yet
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1361733-4003248-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1004.jpg not downloaded yet
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1361733-4003248-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1005.jpg not downloaded yet
2025-12-02 08:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bfa190>
2025-12-02 08:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_5.jpg saved to cache
2025-12-02 08:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63789798d0>
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_4.jpg saved to cache
2025-12-02 08:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379269550>
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1361733-4003248-13.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-13.jpg saved to cache
2025-12-02 08:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1f5b50>
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_3.jpg saved to cache
2025-12-02 08:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637895e950>
2025-12-02 08:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1361733-4003248-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1004.jpg saved to cache
2025-12-02 08:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a041dd0>
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1361733-4003248-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1002.jpg saved to cache
2025-12-02 08:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a00ee50>
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1361733-4003248-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1005.jpg saved to cache
2025-12-02 08:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a000d10>
2025-12-02 08:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1361733-4003248-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1003.jpg saved to cache
2025-12-02 08:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a055110>
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1361733-4003248-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1000.jpg saved to cache
2025-12-02 08:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637894a190>
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_9.jpg saved to cache
2025-12-02 08:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a030bd0>
2025-12-02 08:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_2.jpg saved to cache
2025-12-02 08:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637925c2d0>
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1361733-4003248-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1001.jpg saved to cache
2025-12-02 08:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1c32d0>
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_10.jpg saved to cache
2025-12-02 08:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a184b50>
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_11.jpg saved to cache
2025-12-02 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a150410>
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_1.jpg saved to cache
2025-12-02 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a17a6d0>
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_6.jpg saved to cache
2025-12-02 08:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf)
2025-12-02 08:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001546758-01971823-003.pdf> (referer: None)
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0d8e90>
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_7.jpg saved to cache
2025-12-02 08:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74
2025-12-02 08:01:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc73f181-d6c9-544f-a94c-2aa8cb39ae74, skipping ID generation
2025-12-02 08:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fc73f181-d6c9-544f-a94c-2aa8cb39ae74 from tracking dictionaries
2025-12-02 08:01:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc73f181-d6c9-544f-a94c-2aa8cb39ae74 sending to next pipeline
2025-12-02 08:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fc73f181-d6c9-544f-a94c-2aa8cb39ae74, identifier: 1361733
2025-12-02 08:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fc73f181-d6c9-544f-a94c-2aa8cb39ae74 with identifier: 1361733
2025-12-02 08:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 08:01:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2025-12-02 08:01:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 08:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 08:01:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2025-12-02 08:01:51 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 08:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fc73f181-d6c9-544f-a94c-2aa8cb39ae74 with identifier: 1361733
2025-12-02 08:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2025-12-02 08:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: fc73f181-d6c9-544f-a94c-2aa8cb39ae74 spider: manheim.gb
2025-12-02 08:01:51 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: fc73f181-d6c9-544f-a94c-2aa8cb39ae74 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_expert_report_file_26923bd9-0235-4362-8146-948fda953a54.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001361733-01989594-004.pdf',
'color': 'BLUE',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-02T09:00:00Z',
'fuel_type': 'Diesel',
'id': 'fc73f181-d6c9-544f-a94c-2aa8cb39ae74',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BT65MBF',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/5%20SERIES?id=1361733',
'listing': 'auction',
'location': 'Manchester',
'make': 'BMW',
'model': '5 SERIES',
'odometer': 83626,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 37,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172083,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172083,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252980,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204849,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170978,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178254,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168796,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174889,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175865,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273028,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202237,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 221198,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 251922,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/3f439536-6114-4784-9b32-4be1fc9b0ad6_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295215,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156111,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341648,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218161,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355537,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257310,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fc73f181-d6c9-544f-a94c-2aa8cb39ae74/fc73f181-d6c9-544f-a94c-2aa8cb39ae74_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 249656,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1361733-4003248-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-24',
'seller_name': 'Fords Of Winsford LTD',
'title': 'BMW 5 SERIES 520d [190] M Sport 4dr Step Auto',
'transmission': 'automatic',
'trim': '520d [190] M Sport 4dr Step Auto',
'year': 2015}
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271361733%27 HTTP/1.1" 200 None
2025-12-02 08:01:51 [manheim.gb] INFO: Saving data for 1361733: {'created_time': 1764662511.316448, 'last_price_update_time': 1764662511.316462, 'auction_closing_time': 1764666000.0}
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1361733') HTTP/1.1" 204 0
2025-12-02 08:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379268450>
2025-12-02 08:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1173100-4004079-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1000.jpg saved to cache
2025-12-02 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1852d0>
2025-12-02 08:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_4.jpg saved to cache
2025-12-02 08:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379268410>
2025-12-02 08:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1173100-4004079-13.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-13.jpg saved to cache
2025-12-02 08:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637926abd0>
2025-12-02 08:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_expert_report_file_c712d696-5c9a-4bbf-a96d-80e06f87f4ca.pdf HTTP/1.1" 201 0
2025-12-02 08:01:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 165c7016-28ee-5501-9051-16d20a9d3c9a
2025-12-02 08:01:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 165c7016-28ee-5501-9051-16d20a9d3c9a, skipping ID generation
2025-12-02 08:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 165c7016-28ee-5501-9051-16d20a9d3c9a
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7df7289d-a611-4825-8155-3434808e3af6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_7.jpg already downloaded
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7df7289d-a611-4825-8155-3434808e3af6_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_7.jpg already downloaded
2025-12-02 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7df7289d-a611-4825-8155-3434808e3af6_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_6.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7df7289d-a611-4825-8155-3434808e3af6_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_1.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7df7289d-a611-4825-8155-3434808e3af6_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_5.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7df7289d-a611-4825-8155-3434808e3af6_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_4.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7df7289d-a611-4825-8155-3434808e3af6_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_11.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7df7289d-a611-4825-8155-3434808e3af6_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_10.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7df7289d-a611-4825-8155-3434808e3af6_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_9.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7df7289d-a611-4825-8155-3434808e3af6_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_2.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7df7289d-a611-4825-8155-3434808e3af6_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_5.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7df7289d-a611-4825-8155-3434808e3af6_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_3.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F7df7289d-a611-4825-8155-3434808e3af6_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_4.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1546758-3989344-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-13.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1546758-3989344-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1000.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1546758-3989344-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1001.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1546758-3989344-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1002.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1546758-3989344-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1003.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1546758-3989344-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1004.jpg already downloaded
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1546758-3989344-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1005.jpg already downloaded
2025-12-02 08:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 165c7016-28ee-5501-9051-16d20a9d3c9a, identifier: 1546758
2025-12-02 08:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/CCLASS?id=1639320&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231639320&indx=45> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 165c7016-28ee-5501-9051-16d20a9d3c9a with identifier: 1546758
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2025-12-02 08:01:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 08:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 165c7016-28ee-5501-9051-16d20a9d3c9a with identifier: 1546758
2025-12-02 08:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153439 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153439
2025-12-02 08:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 165c7016-28ee-5501-9051-16d20a9d3c9a spider: manheim.gb
2025-12-02 08:01:53 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 165c7016-28ee-5501-9051-16d20a9d3c9a due to rule: high_mileage_for_country.json, error: 153439 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153439
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_expert_report_file_c712d696-5c9a-4bbf-a96d-80e06f87f4ca.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001546758-01971823-003.pdf',
'color': 'RED',
'currency': 'GBP',
'engine': '1.2L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Petrol',
'id': '165c7016-28ee-5501-9051-16d20a9d3c9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY59KSX',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HYUNDAI/I20?id=1546758',
'listing': 'auction',
'location': 'Colchester',
'make': 'HYUNDAI',
'model': 'I20',
'odometer': 95343,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 36,
'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_6.jpg',
'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_1.jpg',
'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_11.jpg',
'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_10.jpg',
'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_9.jpg',
'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_2.jpg',
'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_3.jpg',
'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-13.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1000.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1001.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1002.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1003.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1004.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1005.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164875,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164875,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272557,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182876,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153111,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150484,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144281,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139971,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148205,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277578,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218321,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250065,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285772,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/7df7289d-a611-4825-8155-3434808e3af6_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332548,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375299,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218745,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303775,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298035,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255349,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_165c7016-28ee-5501-9051-16d20a9d3c9a/165c7016-28ee-5501-9051-16d20a9d3c9a_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393740,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1546758-3989344-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-09-01',
'seller_name': 'EMG Group',
'title': 'HYUNDAI I20 1.2 Comfort 3dr',
'transmission': 'manual',
'trim': '1.2 Comfort 3dr',
'year': 2009}
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271546758%27 HTTP/1.1" 200 None
2025-12-02 08:01:53 [manheim.gb] INFO: Saving data for 1546758: {'created_time': 1764662513.860274, 'last_price_update_time': 1764662513.860287, 'auction_closing_time': 1764838800.0}
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1546758') HTTP/1.1" 204 0
2025-12-02 08:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf)
2025-12-02 08:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=1701386&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231701386&indx=51> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2e9ed0>
2025-12-02 08:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_10.jpg saved to cache
2025-12-02 08:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378978410>
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_9.jpg saved to cache
2025-12-02 08:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fac14423-7150-5962-9e93-8a140a5c8aa8 with identifier: 1639320
2025-12-02 08:01:54 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fac14423-7150-5962-9e93-8a140a5c8aa8
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1f2690>
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_3.jpg saved to cache
2025-12-02 08:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bb0410>
2025-12-02 08:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F33ec44a5-67ca-486f-91eb-7d93b785d449_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_6.jpg saved to cache
2025-12-02 08:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6
2025-12-02 08:01:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6, skipping ID generation
2025-12-02 08:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6 from tracking dictionaries
2025-12-02 08:01:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6 sending to next pipeline
2025-12-02 08:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6, identifier: 1173100
2025-12-02 08:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffdda9e8-fcfb-5878-bd75-8f4780e869b3 with identifier: 1701386
2025-12-02 08:01:55 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6 with identifier: 1173100
2025-12-02 08:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 08:01:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2025-12-02 08:01:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 08:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6 with identifier: 1173100
2025-12-02 08:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 11 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
11
2025-12-02 08:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6 spider: manheim.gb
2025-12-02 08:01:55 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6 due to rule: registration_date_old.json, error: 11 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
11
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_expert_report_file_e794dc25-5648-4ac9-b04c-6ce483a9d586.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001173100-01984307-002.pdf',
'color': 'Black',
'currency': 'GBP',
'engine': '1.6L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Petrol',
'id': '2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MM63XLX',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/PACEMAN?id=1173100',
'listing': 'auction',
'location': 'Colchester',
'make': 'MINI',
'model': 'PACEMAN',
'odometer': 84152,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178046,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178046,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275873,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188537,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183204,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176239,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182641,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173353,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189329,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277134,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205124,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213507,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308289,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/33ec44a5-67ca-486f-91eb-7d93b785d449_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348408,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297601,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423322,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304516,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380659,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271726,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6/2dabb9bb-d2a7-5d0d-a543-472a25e5c6b6_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273068,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1173100-4004079-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-17',
'seller_name': 'Lookers',
'title': 'MINI PACEMAN 1.6 Cooper S ALL4 3dr',
'transmission': 'manual',
'trim': '1.6 Cooper S ALL4 3dr',
'year': 2014}
2025-12-02 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271173100%27 HTTP/1.1" 200 None
2025-12-02 08:01:55 [manheim.gb] INFO: Saving data for 1173100: {'created_time': 1764662515.710827, 'last_price_update_time': 1764662515.710838, 'auction_closing_time': 1764838800.0}
2025-12-02 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1173100') HTTP/1.1" 204 0
2025-12-02 08:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a086390>
2025-12-02 08:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1127441-4003109-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1001.jpg saved to cache
2025-12-02 08:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792f4510>
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_3.jpg saved to cache
2025-12-02 08:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a19be50>
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1127441-4003109-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1000.jpg saved to cache
2025-12-02 08:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=1736358&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231736358&indx=53> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a10ab10>
2025-12-02 08:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_4.jpg saved to cache
2025-12-02 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 261fae57-e3f6-5060-9570-55439dcdcc42 with identifier: 1736358
2025-12-02 08:01:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf> (referer: None)
2025-12-02 08:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf> (referer: None)
2025-12-02 08:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001639320-01980795-005.pdf> (referer: None)
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2cd2d0>
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_5.jpg saved to cache
2025-12-02 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379ba3ad0>
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_9.jpg saved to cache
2025-12-02 08:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1c0410>
2025-12-02 08:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_10.jpg saved to cache
2025-12-02 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792cded0>
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_expert_report_file_76a71f80-79c0-4216-9b6c-e3a0a8ad8731.pdf HTTP/1.1" 201 0
2025-12-02 08:01:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffdda9e8-fcfb-5878-bd75-8f4780e869b3, skipping ID generation
2025-12-02 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_7.jpg not downloaded yet
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378994310>
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_2.jpg saved to cache
2025-12-02 08:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a04f2d0>
2025-12-02 08:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_expert_report_file_63ddd3c2-149d-470e-af0c-c790598fe780.pdf HTTP/1.1" 201 0
2025-12-02 08:01:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5da26166-d7d0-5af2-a580-8a7fdcc24325, skipping ID generation
2025-12-02 08:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_7.jpg not downloaded yet
2025-12-02 08:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379202b10>
2025-12-02 08:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_expert_report_file_cbd5f453-500b-4d5b-ace4-54ee4a5249c2.pdf HTTP/1.1" 201 0
2025-12-02 08:01:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fac14423-7150-5962-9e93-8a140a5c8aa8
2025-12-02 08:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fac14423-7150-5962-9e93-8a140a5c8aa8, skipping ID generation
2025-12-02 08:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item fac14423-7150-5962-9e93-8a140a5c8aa8
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg already downloaded
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg already downloaded
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1d862582-356c-4503-aec2-ef334974cb2f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_6.jpg already downloaded
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1d862582-356c-4503-aec2-ef334974cb2f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_1.jpg already downloaded
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1d862582-356c-4503-aec2-ef334974cb2f_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_5.jpg already downloaded
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1d862582-356c-4503-aec2-ef334974cb2f_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_4.jpg already downloaded
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1d862582-356c-4503-aec2-ef334974cb2f_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_11.jpg already downloaded
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1d862582-356c-4503-aec2-ef334974cb2f_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_10.jpg already downloaded
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1d862582-356c-4503-aec2-ef334974cb2f_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_9.jpg already downloaded
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1d862582-356c-4503-aec2-ef334974cb2f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_2.jpg already downloaded
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1d862582-356c-4503-aec2-ef334974cb2f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_5.jpg already downloaded
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1d862582-356c-4503-aec2-ef334974cb2f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_3.jpg already downloaded
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1d862582-356c-4503-aec2-ef334974cb2f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_4.jpg already downloaded
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1639320-3995202-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-13.jpg already downloaded
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1639320-3995202-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1000.jpg already downloaded
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1639320-3995202-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1001.jpg already downloaded
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1639320-3995202-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1002.jpg already downloaded
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1639320-3995202-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1003.jpg already downloaded
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1639320-3995202-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1004.jpg already downloaded
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1639320-3995202-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1005.jpg already downloaded
2025-12-02 08:02:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fac14423-7150-5962-9e93-8a140a5c8aa8, identifier: 1639320
2025-12-02 08:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf)
2025-12-02 08:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fac14423-7150-5962-9e93-8a140a5c8aa8 with identifier: 1639320
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2025-12-02 08:02:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FHybrid HTTP/1.1" 200 None
2025-12-02 08:02:00 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 08:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fac14423-7150-5962-9e93-8a140a5c8aa8 with identifier: 1639320
2025-12-02 08:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 31, 'seller_name': 'sturgess motor group', 'price_includes_vat': False, 'title': 'mercedes-benz c class c350e sport premium 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'c class', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'petrol/hybrid', 'odometer': 137658, 'odometer_reading_unit': 'mi', 'registration_date': '2018-06-29', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/c%20class?id=1639320', 'location': 'birmingham', 'origin_country_code': 'gb', 'trim': 'c350e sport premium 5dr auto', 'license_plate': 'pj18vjp', 'year': 2018, 'listing': 'auction', 'c_o_2_emission_value': 53, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001639320-01980795-005.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_6.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_1.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_11.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_10.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_9.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_2.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_3.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-13.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1000.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1001.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1002.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1003.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1004.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1005.jpg'], 'id': 'fac14423-7150-5962-9e93-8a140a5c8aa8', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_expert_report_file_cbd5f453-500b-4d5b-ace4-54ee4a5249c2.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 216575}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 216575}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 222760}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 229367}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 199697}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 211258}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 198402}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 215020}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 217645}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 236039}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 175001}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 208437}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 228209}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 321531}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 318368}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 458774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 252512}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 357839}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 148132}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 211902}], 'current_year_diff': 7, 'age_in_months': 89, 'make_model': 'mercedes-benz c class', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 221538}
Failed validating None in schema:
False
On instance:
{'age_in_months': 89,
'auction_title': '',
'c_o_2_emission_value': 53,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_expert_report_file_cbd5f453-500b-4d5b-ace4-54ee4a5249c2.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001639320-01980795-005.pdf',
'color': 'silver',
'currency': 'gbp',
'current_year_diff': 7,
'engine': '2.0l',
'expiration_date': '2025-12-03t09:00:00z',
'fuel_type': 'petrol/hybrid',
'id': 'fac14423-7150-5962-9e93-8a140a5c8aa8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'pj18vjp',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/c%20class?id=1639320',
'listing': 'auction',
'location': 'birmingham',
'make': 'mercedes-benz',
'make_model': 'mercedes-benz c class',
'model': 'c class',
'odometer': 137658,
'odometer_in_km': 221538,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 31,
'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_6.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_1.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_11.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_10.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_9.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_2.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_3.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-13.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1000.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1001.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1002.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1003.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1004.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1005.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216575,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216575,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222760,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229367,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199697,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211258,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198402,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215020,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217645,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236039,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175001,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208437,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228209,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321531,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318368,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458774,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252512,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357839,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148132,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211902,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-29',
'sanitized_make': 'mercedesbenz',
'seller_name': 'sturgess motor group',
'title': 'mercedes-benz c class c350e sport premium 5dr auto',
'transmission': 'automatic',
'trim': 'c350e sport premium 5dr auto',
'year': 2018}
2025-12-02 08:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: fac14423-7150-5962-9e93-8a140a5c8aa8 spider: manheim.gb
2025-12-02 08:02:00 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: fac14423-7150-5962-9e93-8a140a5c8aa8 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 31, 'seller_name': 'sturgess motor group', 'price_includes_vat': False, 'title': 'mercedes-benz c class c350e sport premium 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'c class', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'petrol/hybrid', 'odometer': 137658, 'odometer_reading_unit': 'mi', 'registration_date': '2018-06-29', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/c%20class?id=1639320', 'location': 'birmingham', 'origin_country_code': 'gb', 'trim': 'c350e sport premium 5dr auto', 'license_plate': 'pj18vjp', 'year': 2018, 'listing': 'auction', 'c_o_2_emission_value': 53, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001639320-01980795-005.pdf', 'expiration_date': '2025-12-03t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_6.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_1.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_11.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_10.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_9.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_2.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_5.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_3.jpg', 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_4.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-13.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1000.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1001.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1002.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1003.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1004.jpg', 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1005.jpg'], 'id': 'fac14423-7150-5962-9e93-8a140a5c8aa8', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_expert_report_file_cbd5f453-500b-4d5b-ace4-54ee4a5249c2.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 216575}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 216575}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 222760}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 229367}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 199697}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 211258}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_11.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 198402}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_10.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 215020}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_9.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 217645}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 236039}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 175001}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 208437}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 228209}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 321531}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 318368}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 458774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 252512}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 357839}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 148132}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 211902}], 'current_year_diff': 7, 'age_in_months': 89, 'make_model': 'mercedes-benz c class', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 221538}
Failed validating None in schema:
False
On instance:
{'age_in_months': 89,
'auction_title': '',
'c_o_2_emission_value': 53,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_expert_report_file_cbd5f453-500b-4d5b-ace4-54ee4a5249c2.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001639320-01980795-005.pdf',
'color': 'silver',
'currency': 'gbp',
'current_year_diff': 7,
'engine': '2.0l',
'expiration_date': '2025-12-03t09:00:00z',
'fuel_type': 'petrol/hybrid',
'id': 'fac14423-7150-5962-9e93-8a140a5c8aa8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'pj18vjp',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/mercedes-benz/c%20class?id=1639320',
'listing': 'auction',
'location': 'birmingham',
'make': 'mercedes-benz',
'make_model': 'mercedes-benz c class',
'model': 'c class',
'odometer': 137658,
'odometer_in_km': 221538,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 31,
'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_6.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_1.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_11.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_10.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_9.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_2.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_3.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-13.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1000.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1001.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1002.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1003.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1004.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1005.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216575,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216575,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222760,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229367,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199697,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211258,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198402,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215020,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217645,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236039,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175001,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208437,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228209,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321531,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318368,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458774,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252512,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357839,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148132,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211902,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-29',
'sanitized_make': 'mercedesbenz',
'seller_name': 'sturgess motor group',
'title': 'mercedes-benz c class c350e sport premium 5dr auto',
'transmission': 'automatic',
'trim': 'c350e sport premium 5dr auto',
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 53,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_expert_report_file_cbd5f453-500b-4d5b-ace4-54ee4a5249c2.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001639320-01980795-005.pdf',
'color': 'SILVER',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-03T09:00:00Z',
'fuel_type': 'Petrol/Hybrid',
'id': 'fac14423-7150-5962-9e93-8a140a5c8aa8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ18VJP',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/C%20CLASS?id=1639320',
'listing': 'auction',
'location': 'Birmingham',
'make': 'MERCEDES-BENZ',
'model': 'C CLASS',
'odometer': 137658,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 31,
'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_6.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_1.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_11.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_10.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_9.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_2.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_5.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_3.jpg',
'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_4.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-13.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1000.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1001.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1002.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1003.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1004.jpg',
'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1005.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216575,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216575,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222760,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229367,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199697,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211258,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198402,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215020,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217645,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 236039,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175001,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208437,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228209,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1d862582-356c-4503-aec2-ef334974cb2f_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321531,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318368,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458774,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252512,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357839,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148132,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fac14423-7150-5962-9e93-8a140a5c8aa8/fac14423-7150-5962-9e93-8a140a5c8aa8_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211902,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1639320-3995202-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-29',
'seller_name': 'Sturgess Motor Group',
'title': 'MERCEDES-BENZ C CLASS C350e Sport Premium 5dr Auto',
'transmission': 'automatic',
'trim': 'C350e Sport Premium 5dr Auto',
'year': 2018}
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271639320%27 HTTP/1.1" 200 None
2025-12-02 08:02:00 [manheim.gb] INFO: Saving data for 1639320: {'created_time': 1764662520.918475, 'last_price_update_time': 1764662520.918488, 'auction_closing_time': 1764752400.0}
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1639320') HTTP/1.1" 204 0
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_7.jpg not downloaded yet
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_7.jpg not downloaded yet
2025-12-02 08:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=1864706&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231864706&indx=65> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_6.jpg not downloaded yet
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_6.jpg not downloaded yet
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a150890>
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_1.jpg saved to cache
2025-12-02 08:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3c37d0>
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_11.jpg saved to cache
2025-12-02 08:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3a9e90>
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_5.jpg saved to cache
2025-12-02 08:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3bb250>
2025-12-02 08:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg saved to cache
2025-12-02 08:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a39c390>
2025-12-02 08:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F9f364bb7-933d-4885-a5ec-166c18b34939_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_6.jpg saved to cache
2025-12-02 08:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818
2025-12-02 08:02:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5be135ec-c9fe-55f1-b809-f70ed7ffc818, skipping ID generation
2025-12-02 08:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5be135ec-c9fe-55f1-b809-f70ed7ffc818 from tracking dictionaries
2025-12-02 08:02:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5be135ec-c9fe-55f1-b809-f70ed7ffc818 sending to next pipeline
2025-12-02 08:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5be135ec-c9fe-55f1-b809-f70ed7ffc818, identifier: 1127441
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_1.jpg not downloaded yet
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_1.jpg not downloaded yet
2025-12-02 08:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5be135ec-c9fe-55f1-b809-f70ed7ffc818 with identifier: 1127441
2025-12-02 08:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5be135ec-c9fe-55f1-b809-f70ed7ffc818 with identifier: 1127441
2025-12-02 08:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 45, 'seller_name': 'mawsley motor company ltd', 'price_includes_vat': False, 'title': 'volkswagen passat 2.0 tdi bluemotion tech highline 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'passat', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 135871, 'odometer_reading_unit': 'mi', 'registration_date': '2013-03-08', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/passat?id=1127441', 'location': 'northampton', 'origin_country_code': 'gb', 'trim': '2.0 tdi bluemotion tech highline 5dr', 'license_plate': 'rx13mhf', 'year': 2013, 'listing': 'auction', 'c_o_2_emission_value': 120, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001127441-01988485-002.pdf', 'expiration_date': '2025-12-02t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '5be135ec-c9fe-55f1-b809-f70ed7ffc818', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_expert_report_file_d627aaf6-978d-4ca1-936d-5d4d17294945.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 244022}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 244022}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 279679}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 187597}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 245294}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 237150}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 243122}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 233913}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 257929}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 317345}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 229556}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 223757}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 261645}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 301055}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 204223}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 137600}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 254982}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 220705}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 285904}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 274254}], 'current_year_diff': 12, 'age_in_months': 152, 'make_model': 'volkswagen passat', 'sanitized_make': 'volkswagen', 'odometer_in_km': 218662}
Failed validating None in schema:
False
On instance:
{'age_in_months': 152,
'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_expert_report_file_d627aaf6-978d-4ca1-936d-5d4d17294945.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001127441-01988485-002.pdf',
'color': 'red',
'currency': 'gbp',
'current_year_diff': 12,
'engine': '2.0l',
'expiration_date': '2025-12-02t09:00:00z',
'fuel_type': 'diesel',
'id': '5be135ec-c9fe-55f1-b809-f70ed7ffc818',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'rx13mhf',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/passat?id=1127441',
'listing': 'auction',
'location': 'northampton',
'make': 'volkswagen',
'make_model': 'volkswagen passat',
'model': 'passat',
'odometer': 135871,
'odometer_in_km': 218662,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 45,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244022,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244022,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279679,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187597,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245294,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237150,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243122,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233913,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257929,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317345,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229556,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223757,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261645,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301055,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204223,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137600,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254982,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220705,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285904,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274254,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-08',
'sanitized_make': 'volkswagen',
'seller_name': 'mawsley motor company ltd',
'title': 'volkswagen passat 2.0 tdi bluemotion tech highline 5dr',
'transmission': 'manual',
'trim': '2.0 tdi bluemotion tech highline 5dr',
'year': 2013}
2025-12-02 08:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 5be135ec-c9fe-55f1-b809-f70ed7ffc818 spider: manheim.gb
2025-12-02 08:02:02 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 5be135ec-c9fe-55f1-b809-f70ed7ffc818 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 45, 'seller_name': 'mawsley motor company ltd', 'price_includes_vat': False, 'title': 'volkswagen passat 2.0 tdi bluemotion tech highline 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'passat', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 135871, 'odometer_reading_unit': 'mi', 'registration_date': '2013-03-08', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/passat?id=1127441', 'location': 'northampton', 'origin_country_code': 'gb', 'trim': '2.0 tdi bluemotion tech highline 5dr', 'license_plate': 'rx13mhf', 'year': 2013, 'listing': 'auction', 'c_o_2_emission_value': 120, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001127441-01988485-002.pdf', 'expiration_date': '2025-12-02t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '5be135ec-c9fe-55f1-b809-f70ed7ffc818', 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_expert_report_file_d627aaf6-978d-4ca1-936d-5d4d17294945.pdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_0.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 244022}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_1.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg', 'Width': 1499, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 244022}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_2.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_6.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 279679}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_3.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_1.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 187597}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_4.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_5.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 245294}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_5.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_4.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 237150}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_6.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_11.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 243122}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_7.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_10.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 233913}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_8.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_9.jpg', 'Width': 1500, 'Height': 999, 'Extension': 'jpg', 'FileSizeInBytes': 257929}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_9.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_2.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 317345}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_10.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_5.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 229556}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_11.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_3.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 223757}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_12.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_4.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 261645}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_13.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-13.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 301055}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_14.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1000.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 204223}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_15.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1001.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 137600}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_16.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1002.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 254982}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_17.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1003.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 220705}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_18.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1004.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 285904}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_19.jpg', 'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1005.jpg', 'Width': 1333, 'Height': 1000, 'Extension': 'jpg', 'FileSizeInBytes': 274254}], 'current_year_diff': 12, 'age_in_months': 152, 'make_model': 'volkswagen passat', 'sanitized_make': 'volkswagen', 'odometer_in_km': 218662}
Failed validating None in schema:
False
On instance:
{'age_in_months': 152,
'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_expert_report_file_d627aaf6-978d-4ca1-936d-5d4d17294945.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001127441-01988485-002.pdf',
'color': 'red',
'currency': 'gbp',
'current_year_diff': 12,
'engine': '2.0l',
'expiration_date': '2025-12-02t09:00:00z',
'fuel_type': 'diesel',
'id': '5be135ec-c9fe-55f1-b809-f70ed7ffc818',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'rx13mhf',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/passat?id=1127441',
'listing': 'auction',
'location': 'northampton',
'make': 'volkswagen',
'make_model': 'volkswagen passat',
'model': 'passat',
'odometer': 135871,
'odometer_in_km': 218662,
'odometer_reading_unit': 'mi',
'origin_country_code': 'gb',
'original_photo_count': 45,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244022,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244022,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279679,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187597,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245294,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237150,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243122,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233913,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257929,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317345,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229556,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223757,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261645,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301055,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204223,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137600,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254982,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220705,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285904,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274254,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-08',
'sanitized_make': 'volkswagen',
'seller_name': 'mawsley motor company ltd',
'title': 'volkswagen passat 2.0 tdi bluemotion tech highline 5dr',
'transmission': 'manual',
'trim': '2.0 tdi bluemotion tech highline 5dr',
'year': 2013}
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_expert_report_file_d627aaf6-978d-4ca1-936d-5d4d17294945.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001127441-01988485-002.pdf',
'color': 'RED',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-02T09:00:00Z',
'fuel_type': 'Diesel',
'id': '5be135ec-c9fe-55f1-b809-f70ed7ffc818',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RX13MHF',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/PASSAT?id=1127441',
'listing': 'auction',
'location': 'Northampton',
'make': 'VOLKSWAGEN',
'model': 'PASSAT',
'odometer': 135871,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 45,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244022,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244022,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279679,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187597,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245294,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237150,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243122,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233913,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257929,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317345,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229556,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223757,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261645,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/9f364bb7-933d-4885-a5ec-166c18b34939_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301055,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204223,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137600,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 254982,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220705,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285904,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be135ec-c9fe-55f1-b809-f70ed7ffc818/5be135ec-c9fe-55f1-b809-f70ed7ffc818_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274254,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1127441-4003109-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-03-08',
'seller_name': 'MAWSLEY MOTOR COMPANY LTD',
'title': 'VOLKSWAGEN PASSAT 2.0 TDI Bluemotion Tech Highline 5dr',
'transmission': 'manual',
'trim': '2.0 TDI Bluemotion Tech Highline 5dr',
'year': 2013}
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271127441%27 HTTP/1.1" 200 None
2025-12-02 08:02:02 [manheim.gb] INFO: Saving data for 1127441: {'created_time': 1764662522.994519, 'last_price_update_time': 1764662522.994531, 'auction_closing_time': 1764666000.0}
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1127441') HTTP/1.1" 204 0
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_5.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_5.jpg not downloaded yet
2025-12-02 08:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/NOTE?id=1798612&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231798612&indx=57> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ACLASS?id=1762778&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231762778&indx=55> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36fc41d9-ead6-5680-bfd0-7385ea3c0872 with identifier: 1864706
2025-12-02 08:02:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_4.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_4.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_11.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_11.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_10.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_10.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_9.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_9.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_2.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_2.jpg not downloaded yet
2025-12-02 08:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06d87df0-6aef-5d6d-8442-100ba6aaef5a with identifier: 1798612
2025-12-02 08:02:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b68bb94-5555-5c41-a751-d57889503292 with identifier: 1762778
2025-12-02 08:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b68bb94-5555-5c41-a751-d57889503292 with scrape type 1
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 13 photos for item 5b68bb94-5555-5c41-a751-d57889503292
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_7.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_5.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_5.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_7.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_3.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_3.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_6.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_4.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_4.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_1.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1701386-4003037-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-13.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1104811-4003600-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-13.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_5.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1701386-4003037-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1000.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1104811-4003600-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1000.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_4.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1701386-4003037-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1001.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1104811-4003600-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1001.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_11.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1701386-4003037-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1002.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1104811-4003600-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1002.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_10.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1701386-4003037-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1003.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1104811-4003600-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1003.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_9.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1701386-4003037-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1004.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1104811-4003600-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1004.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_2.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1701386-4003037-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1005.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1104811-4003600-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1005.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_5.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_3.jpg not downloaded yet
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_4.jpg not downloaded yet
2025-12-02 08:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf> (referer: None)
2025-12-02 08:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3bbf10>
2025-12-02 08:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_expert_report_file_6f8bfc0c-c91b-4325-a5b3-20765db82f3f.pdf HTTP/1.1" 201 0
2025-12-02 08:02:04 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 261fae57-e3f6-5060-9570-55439dcdcc42, skipping ID generation
2025-12-02 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_7.jpg not downloaded yet
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_7.jpg not downloaded yet
2025-12-02 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_5.jpg> (referer: None)
2025-12-02 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_3.jpg> (referer: None)
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_6.jpg not downloaded yet
2025-12-02 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_9.jpg> (referer: None)
2025-12-02 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_2.jpg> (referer: None)
2025-12-02 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_1.jpg not downloaded yet
2025-12-02 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_5.jpg not downloaded yet
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_4.jpg not downloaded yet
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_11.jpg not downloaded yet
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_10.jpg not downloaded yet
2025-12-02 08:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2a9f50>
2025-12-02 08:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_5.jpg saved to cache
2025-12-02 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5b68bb94-5555-5c41-a751-d57889503292
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792f4b10>
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1104811-4003600-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1005.jpg saved to cache
2025-12-02 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_9.jpg not downloaded yet
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1b96d0>
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_3.jpg saved to cache
2025-12-02 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5b68bb94-5555-5c41-a751-d57889503292
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a264310>
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1701386-4003037-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1005.jpg saved to cache
2025-12-02 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a15d710>
2025-12-02 08:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_9.jpg saved to cache
2025-12-02 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b68bb94-5555-5c41-a751-d57889503292
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2abb10>
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_2.jpg saved to cache
2025-12-02 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b68bb94-5555-5c41-a751-d57889503292
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_2.jpg not downloaded yet
2025-12-02 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/308?id=1989821&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231989821&indx=74> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_4.jpg> (referer: None)
2025-12-02 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_10.jpg> (referer: None)
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_5.jpg not downloaded yet
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0cc110>
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1104811-4003600-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1004.jpg saved to cache
2025-12-02 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a259bd0>
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1701386-4003037-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1004.jpg saved to cache
2025-12-02 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_3.jpg not downloaded yet
2025-12-02 08:02:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db38ca89-4b9c-51b4-9d1d-4e831c058600 with identifier: 1989821
2025-12-02 08:02:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792bdd10>
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_4.jpg saved to cache
2025-12-02 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5b68bb94-5555-5c41-a751-d57889503292
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0549d0>
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1104811-4003600-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1002.jpg saved to cache
2025-12-02 08:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3c2c90>
2025-12-02 08:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_7.jpg saved to cache
2025-12-02 08:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a37f8d0>
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_7.jpg saved to cache
2025-12-02 08:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a192610>
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_10.jpg saved to cache
2025-12-02 08:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b68bb94-5555-5c41-a751-d57889503292
2025-12-02 08:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_11.jpg> (referer: None)
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_4.jpg not downloaded yet
2025-12-02 08:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1736358-3983007-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-13.jpg not downloaded yet
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a061810>
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1104811-4003600-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1003.jpg saved to cache
2025-12-02 08:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379ba0450>
2025-12-02 08:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1701386-4003037-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1003.jpg saved to cache
2025-12-02 08:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2dc810>
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1701386-4003037-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1002.jpg saved to cache
2025-12-02 08:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1736358-3983007-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1000.jpg not downloaded yet
2025-12-02 08:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3a9450>
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_11.jpg saved to cache
2025-12-02 08:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b68bb94-5555-5c41-a751-d57889503292
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a343a90>
2025-12-02 08:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_6.jpg saved to cache
2025-12-02 08:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1736358-3983007-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1001.jpg not downloaded yet
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1736358-3983007-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1002.jpg not downloaded yet
2025-12-02 08:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1736358-3983007-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1003.jpg not downloaded yet
2025-12-02 08:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a4c1e90>
2025-12-02 08:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1104811-4003600-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1001.jpg saved to cache
2025-12-02 08:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1736358-3983007-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1004.jpg not downloaded yet
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1736358-3983007-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1005.jpg not downloaded yet
2025-12-02 08:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a472490>
2025-12-02 08:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_5.jpg saved to cache
2025-12-02 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a457350>
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_3.jpg saved to cache
2025-12-02 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a453090>
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_10.jpg saved to cache
2025-12-02 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a4330d0>
2025-12-02 08:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_9.jpg saved to cache
2025-12-02 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a45ead0>
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_2.jpg saved to cache
2025-12-02 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a407210>
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_4.jpg saved to cache
2025-12-02 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a5eea90>
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_11.jpg saved to cache
2025-12-02 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0a6450>
2025-12-02 08:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_4.jpg saved to cache
2025-12-02 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637890ee10>
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_5.jpg saved to cache
2025-12-02 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_4.jpg> (referer: None)
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379b8f410>
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fd441a130-a87b-4fa3-b335-477ef106bd29_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_1.jpg saved to cache
2025-12-02 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a29a1d0>
2025-12-02 08:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1736358-3983007-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1002.jpg saved to cache
2025-12-02 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf)
2025-12-02 08:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_5.jpg> (referer: None)
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a327d10>
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1736358-3983007-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1000.jpg saved to cache
2025-12-02 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a191450>
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1736358-3983007-13.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-13.jpg saved to cache
2025-12-02 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a03a990>
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1701386-4003037-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1001.jpg saved to cache
2025-12-02 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2cd890>
2025-12-02 08:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1736358-3983007-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1001.jpg saved to cache
2025-12-02 08:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0386d0>
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1104811-4003600-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1000.jpg saved to cache
2025-12-02 08:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378989c90>
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_4.jpg saved to cache
2025-12-02 08:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b68bb94-5555-5c41-a751-d57889503292
2025-12-02 08:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_1.jpg> (referer: None)
2025-12-02 08:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_6.jpg> (referer: None)
2025-12-02 08:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a287310>
2025-12-02 08:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1736358-3983007-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1005.jpg saved to cache
2025-12-02 08:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1b9f10>
2025-12-02 08:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1736358-3983007-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1003.jpg saved to cache
2025-12-02 08:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2b8710>
2025-12-02 08:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1736358-3983007-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1004.jpg saved to cache
2025-12-02 08:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 261fae57-e3f6-5060-9570-55439dcdcc42
2025-12-02 08:02:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 261fae57-e3f6-5060-9570-55439dcdcc42, skipping ID generation
2025-12-02 08:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 261fae57-e3f6-5060-9570-55439dcdcc42 from tracking dictionaries
2025-12-02 08:02:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 261fae57-e3f6-5060-9570-55439dcdcc42 sending to next pipeline
2025-12-02 08:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 261fae57-e3f6-5060-9570-55439dcdcc42, identifier: 1736358
2025-12-02 08:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379229290>
2025-12-02 08:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_5.jpg saved to cache
2025-12-02 08:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b68bb94-5555-5c41-a751-d57889503292
2025-12-02 08:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 261fae57-e3f6-5060-9570-55439dcdcc42 with identifier: 1736358
2025-12-02 08:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 08:02:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Pearl+White HTTP/1.1" 200 None
2025-12-02 08:02:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 08:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 261fae57-e3f6-5060-9570-55439dcdcc42 with identifier: 1736358
2025-12-02 08:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 261fae57-e3f6-5060-9570-55439dcdcc42 with identifier: 1736358 to the API
2025-12-02 08:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 08:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1004.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_expert_report_file_6f8bfc0c-c91b-4325-a5b3-20765db82f3f.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001736358-01967729-003.pdf',
'color': 'Pearl White',
'currency': 'GBP',
'engine': '1.6L',
'expiration_date': '2025-12-03T09:00:00Z',
'fuel_type': 'Diesel',
'id': '261fae57-e3f6-5060-9570-55439dcdcc42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CV67NVN',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=1736358',
'listing': 'auction',
'location': 'Leeds - In Transit',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 64303,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 42,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212758,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 212758,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230085,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151918,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199440,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208961,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 202386,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217505,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224354,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215173,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183699,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204672,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200781,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/d441a130-a87b-4fa3-b335-477ef106bd29_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304355,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285136,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295344,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177886,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175542,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151530,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_261fae57-e3f6-5060-9570-55439dcdcc42/261fae57-e3f6-5060-9570-55439dcdcc42_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182555,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1736358-3983007-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-09-29',
'seller_name': 'Peugeot',
'title': 'PEUGEOT 3008 1.6 BlueHDi 120 Allure 5dr',
'transmission': 'manual',
'trim': '1.6 BlueHDi 120 Allure 5dr',
'year': 2017}
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271736358%27 HTTP/1.1" 200 None
2025-12-02 08:02:18 [manheim.gb] INFO: Saving data for 1736358: {'created_time': 1764662538.189623, 'last_price_update_time': 1764662538.189637, 'auction_closing_time': 1764752400.0}
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1736358') HTTP/1.1" 204 0
2025-12-02 08:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_7.jpg> (referer: None)
2025-12-02 08:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a4e2a50>
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1701386-4003037-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1000.jpg saved to cache
2025-12-02 08:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378928850>
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1104811-4003600-13.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-13.jpg saved to cache
2025-12-02 08:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a39eed0>
2025-12-02 08:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_1.jpg saved to cache
2025-12-02 08:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b68bb94-5555-5c41-a751-d57889503292
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637892b1d0>
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_6.jpg saved to cache
2025-12-02 08:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b68bb94-5555-5c41-a751-d57889503292
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a4e3290>
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_4.jpg saved to cache
2025-12-02 08:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a15dc90>
2025-12-02 08:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_4.jpg saved to cache
2025-12-02 08:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a000050>
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1701386-4003037-13.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-13.jpg saved to cache
2025-12-02 08:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf> (referer: None)
2025-12-02 08:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_7.jpg> (referer: None)
2025-12-02 08:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bae250>
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_5.jpg saved to cache
2025-12-02 08:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3cbe50>
2025-12-02 08:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_3.jpg saved to cache
2025-12-02 08:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637926ba10>
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_3.jpg saved to cache
2025-12-02 08:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792f7010>
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_7.jpg saved to cache
2025-12-02 08:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b68bb94-5555-5c41-a751-d57889503292
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792f6210>
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_5.jpg saved to cache
2025-12-02 08:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=2091777&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232091777&indx=82> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a23bed0>
2025-12-02 08:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_expert_report_file_4a992ec2-af21-473b-98cb-cfcb60b42928.pdf HTTP/1.1" 201 0
2025-12-02 08:02:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db38ca89-4b9c-51b4-9d1d-4e831c058600, skipping ID generation
2025-12-02 08:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_7.jpg not downloaded yet
2025-12-02 08:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a24aed0>
2025-12-02 08:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F72eb543b-0223-41f1-b832-76bf7ef2c900_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_7.jpg saved to cache
2025-12-02 08:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b68bb94-5555-5c41-a751-d57889503292
2025-12-02 08:02:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b68bb94-5555-5c41-a751-d57889503292, skipping ID generation
2025-12-02 08:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b68bb94-5555-5c41-a751-d57889503292 with scrape type 1
2025-12-02 08:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5b68bb94-5555-5c41-a751-d57889503292 from tracking dictionaries
2025-12-02 08:02:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b68bb94-5555-5c41-a751-d57889503292 sending to next pipeline
2025-12-02 08:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5b68bb94-5555-5c41-a751-d57889503292, identifier: 1762778
2025-12-02 08:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bf8490>
2025-12-02 08:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_2.jpg saved to cache
2025-12-02 08:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5b68bb94-5555-5c41-a751-d57889503292 with identifier: 1762778
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2025-12-02 08:02:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 08:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5b68bb94-5555-5c41-a751-d57889503292 with identifier: 1762778
2025-12-02 08:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 185043 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
185043
2025-12-02 08:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5b68bb94-5555-5c41-a751-d57889503292 spider: manheim.gb
2025-12-02 08:02:23 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 5b68bb94-5555-5c41-a751-d57889503292 due to rule: high_mileage_for_country.json, error: 185043 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
185043
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_source_url': None,
'color': 'Silver',
'currency': 'GBP',
'engine': '1.5L',
'expiration_date': '2025-12-10T09:00:00Z',
'fuel_type': 'Diesel',
'id': '5b68bb94-5555-5c41-a751-d57889503292',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CX15WLK',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=1762778',
'listing': 'auction',
'location': 'Birmingham',
'make': 'MERCEDES-BENZ',
'model': 'A CLASS',
'odometer': 114981,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197510,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197510,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160127,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170223,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201486,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198601,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184972,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199545,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210302,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178099,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149511,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152976,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b68bb94-5555-5c41-a751-d57889503292/5b68bb94-5555-5c41-a751-d57889503292_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189331,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/72eb543b-0223-41f1-b832-76bf7ef2c900_ext_4.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-04-22',
'seller_name': 'Hilton Garage Ltd',
'title': 'MERCEDES-BENZ A CLASS A180 [1.5] CDI SE 5dr Auto',
'transmission': 'automatic',
'trim': 'A180 [1.5] CDI SE 5dr Auto',
'year': 2015}
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271762778%27 HTTP/1.1" 200 None
2025-12-02 08:02:23 [manheim.gb] INFO: Saving data for 1762778: {'created_time': 1764662543.697851, 'last_price_update_time': 1764662543.697862, 'auction_closing_time': 1765357200.0}
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1762778') HTTP/1.1" 204 0
2025-12-02 08:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_7.jpg not downloaded yet
2025-12-02 08:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_6.jpg not downloaded yet
2025-12-02 08:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637893a410>
2025-12-02 08:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_9.jpg saved to cache
2025-12-02 08:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3b9410>
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_2.jpg saved to cache
2025-12-02 08:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e with identifier: 2091777
2025-12-02 08:02:24 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a04fcd0>
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_10.jpg saved to cache
2025-12-02 08:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378949010>
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_11.jpg saved to cache
2025-12-02 08:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a122d90>
2025-12-02 08:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_4.jpg saved to cache
2025-12-02 08:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a48fbd0>
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_10.jpg saved to cache
2025-12-02 08:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_1.jpg not downloaded yet
2025-12-02 08:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2058572&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232058572&indx=80> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_5.jpg not downloaded yet
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a191210>
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_9.jpg saved to cache
2025-12-02 08:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a187150>
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_11.jpg saved to cache
2025-12-02 08:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a001ed0>
2025-12-02 08:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_5.jpg saved to cache
2025-12-02 08:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a190850>
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_4.jpg saved to cache
2025-12-02 08:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_4.jpg not downloaded yet
2025-12-02 08:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2876842-745d-59e6-b4ec-f2a23163a614 with identifier: 2058572
2025-12-02 08:02:26 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_11.jpg not downloaded yet
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_10.jpg not downloaded yet
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_9.jpg not downloaded yet
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_2.jpg not downloaded yet
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_5.jpg not downloaded yet
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a086650>
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_1.jpg saved to cache
2025-12-02 08:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a087dd0>
2025-12-02 08:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_7.jpg saved to cache
2025-12-02 08:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a384710>
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_7.jpg saved to cache
2025-12-02 08:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a131090>
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_1.jpg saved to cache
2025-12-02 08:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a23a910>
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_5.jpg saved to cache
2025-12-02 08:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a23b490>
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_6.jpg saved to cache
2025-12-02 08:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a453350>
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_7.jpg saved to cache
2025-12-02 08:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_3.jpg not downloaded yet
2025-12-02 08:02:28 [scrapy.extensions.logstats] INFO: Crawled 30 pages (at 27 pages/min), scraped 2 items (at 2 items/min)
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a5703d0>
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_6.jpg saved to cache
2025-12-02 08:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_4.jpg not downloaded yet
2025-12-02 08:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/KIA/PICANTO?id=2057516&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232057516&indx=79> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf)
2025-12-02 08:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf)
2025-12-02 08:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1989821-4004051-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-13.jpg not downloaded yet
2025-12-02 08:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1989821-4004051-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1000.jpg not downloaded yet
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1989821-4004051-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1001.jpg not downloaded yet
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1989821-4004051-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1002.jpg not downloaded yet
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1989821-4004051-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1003.jpg not downloaded yet
2025-12-02 08:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be58e6f6-2608-5d15-be6a-b49e5f011661 with identifier: 2057516
2025-12-02 08:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a21b310>
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_7.jpg saved to cache
2025-12-02 08:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a5e0ad0>
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Ff27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_7.jpg saved to cache
2025-12-02 08:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5da26166-d7d0-5af2-a580-8a7fdcc24325
2025-12-02 08:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5da26166-d7d0-5af2-a580-8a7fdcc24325, skipping ID generation
2025-12-02 08:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5da26166-d7d0-5af2-a580-8a7fdcc24325 from tracking dictionaries
2025-12-02 08:02:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5da26166-d7d0-5af2-a580-8a7fdcc24325 sending to next pipeline
2025-12-02 08:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5da26166-d7d0-5af2-a580-8a7fdcc24325, identifier: 1104811
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a25b4d0>
2025-12-02 08:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_5.jpg saved to cache
2025-12-02 08:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a24b5d0>
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_6.jpg saved to cache
2025-12-02 08:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bad810>
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbf517417-e46a-4278-bb38-228bf348b9d0_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_7.jpg saved to cache
2025-12-02 08:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3
2025-12-02 08:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffdda9e8-fcfb-5878-bd75-8f4780e869b3, skipping ID generation
2025-12-02 08:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ffdda9e8-fcfb-5878-bd75-8f4780e869b3 from tracking dictionaries
2025-12-02 08:02:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffdda9e8-fcfb-5878-bd75-8f4780e869b3 sending to next pipeline
2025-12-02 08:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ffdda9e8-fcfb-5878-bd75-8f4780e869b3, identifier: 1701386
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637b9cf210>
2025-12-02 08:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1089633-4003813-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1003.jpg saved to cache
2025-12-02 08:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a17bb50>
2025-12-02 08:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_1.jpg saved to cache
2025-12-02 08:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf> (referer: None)
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1989821-4004051-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1004.jpg not downloaded yet
2025-12-02 08:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5da26166-d7d0-5af2-a580-8a7fdcc24325 with identifier: 1104811
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2025-12-02 08:02:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 08:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5da26166-d7d0-5af2-a580-8a7fdcc24325 with identifier: 1104811
2025-12-02 08:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 16 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
16
2025-12-02 08:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 5da26166-d7d0-5af2-a580-8a7fdcc24325 spider: manheim.gb
2025-12-02 08:02:31 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 5da26166-d7d0-5af2-a580-8a7fdcc24325 due to rule: registration_date_old.json, error: 16 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
16
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_expert_report_file_63ddd3c2-149d-470e-af0c-c790598fe780.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001104811-01988733-003.pdf',
'color': 'WHITE',
'currency': 'GBP',
'engine': '1.4L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Petrol',
'id': '5da26166-d7d0-5af2-a580-8a7fdcc24325',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ59YWR',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/CLUBMAN?id=1104811',
'listing': 'auction',
'location': 'Colchester',
'make': 'MINI',
'model': 'CLUBMAN',
'odometer': 65791,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160731,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160731,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265640,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230694,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153611,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151394,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159682,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155702,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160743,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258948,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195445,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233823,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226333,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/f27cb09a-2856-4fce-a9c1-45c9766b00cd_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289454,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258805,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271480,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165075,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284415,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326076,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5da26166-d7d0-5af2-a580-8a7fdcc24325/5da26166-d7d0-5af2-a580-8a7fdcc24325_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163265,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1104811-4003600-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-11-27',
'seller_name': 'Big Motoring World Ltd',
'title': 'MINI CLUBMAN 1.4 One 5dr',
'transmission': 'manual',
'trim': '1.4 One 5dr',
'year': 2009}
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271104811%27 HTTP/1.1" 200 None
2025-12-02 08:02:31 [manheim.gb] INFO: Saving data for 1104811: {'created_time': 1764662551.824944, 'last_price_update_time': 1764662551.824954, 'auction_closing_time': 1764838800.0}
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1104811') HTTP/1.1" 204 0
2025-12-02 08:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ffdda9e8-fcfb-5878-bd75-8f4780e869b3 with identifier: 1701386
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2025-12-02 08:02:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-02 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-02 08:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ffdda9e8-fcfb-5878-bd75-8f4780e869b3 with identifier: 1701386
2025-12-02 08:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 167981 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
167981
2025-12-02 08:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ffdda9e8-fcfb-5878-bd75-8f4780e869b3 spider: manheim.gb
2025-12-02 08:02:32 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: ffdda9e8-fcfb-5878-bd75-8f4780e869b3 due to rule: high_mileage_for_country.json, error: 167981 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
167981
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_expert_report_file_76a71f80-79c0-4216-9b6c-e3a0a8ad8731.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001701386-01983453-002.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '1.5L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Petrol',
'id': 'ffdda9e8-fcfb-5878-bd75-8f4780e869b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND16MFX',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=1701386',
'listing': 'auction',
'location': 'Leeds',
'make': 'MINI',
'model': 'HATCHBACK',
'odometer': 104379,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 27,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213742,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213742,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239998,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181556,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203312,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176938,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201937,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195389,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199905,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243001,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208585,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211280,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227859,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bf517417-e46a-4278-bb38-228bf348b9d0_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308272,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304784,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298591,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358258,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286934,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364713,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffdda9e8-fcfb-5878-bd75-8f4780e869b3/ffdda9e8-fcfb-5878-bd75-8f4780e869b3_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222160,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1701386-4003037-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-08-25',
'seller_name': 'Pentagon Group',
'title': 'MINI HATCHBACK 1.5 Cooper 5dr',
'transmission': 'manual',
'trim': '1.5 Cooper 5dr',
'year': 2016}
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271701386%27 HTTP/1.1" 200 None
2025-12-02 08:02:32 [manheim.gb] INFO: Saving data for 1701386: {'created_time': 1764662552.224462, 'last_price_update_time': 1764662552.224478, 'auction_closing_time': 1764838800.0}
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1701386') HTTP/1.1" 204 0
2025-12-02 08:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1989821-4004051-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1005.jpg not downloaded yet
2025-12-02 08:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a184f50>
2025-12-02 08:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1089633-4003813-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1004.jpg saved to cache
2025-12-02 08:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=2014140&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232014140&indx=76> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a376590>
2025-12-02 08:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_expert_report_file_6e9cb9b7-2273-4e71-bc92-3b68873b585a.pdf HTTP/1.1" 201 0
2025-12-02 08:02:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:02:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06d87df0-6aef-5d6d-8442-100ba6aaef5a, skipping ID generation
2025-12-02 08:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_7.jpg not downloaded yet
2025-12-02 08:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792009d0>
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1089633-4003813-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1001.jpg saved to cache
2025-12-02 08:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_7.jpg not downloaded yet
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2644d0>
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1089633-4003813-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1002.jpg saved to cache
2025-12-02 08:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378921bd0>
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_9.jpg saved to cache
2025-12-02 08:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637897a410>
2025-12-02 08:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_4.jpg saved to cache
2025-12-02 08:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2712f63-9d5d-5b54-8849-3e91022144b6 with identifier: 2014140
2025-12-02 08:02:34 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3f4410>
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_3.jpg saved to cache
2025-12-02 08:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3f4410>
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_2.jpg saved to cache
2025-12-02 08:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a00d750>
2025-12-02 08:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_5.jpg saved to cache
2025-12-02 08:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_6.jpg not downloaded yet
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_1.jpg not downloaded yet
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2de850>
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1089633-4003813-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1000.jpg saved to cache
2025-12-02 08:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_5.jpg not downloaded yet
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378923fd0>
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_11.jpg saved to cache
2025-12-02 08:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a193ed0>
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_10.jpg saved to cache
2025-12-02 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bf4e50>
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fba2c75c3-d6a7-4aeb-855e-385261aff2b8_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_4.jpg saved to cache
2025-12-02 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_4.jpg not downloaded yet
2025-12-02 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_11.jpg not downloaded yet
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_10.jpg not downloaded yet
2025-12-02 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf> (referer: None)
2025-12-02 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf)
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_9.jpg not downloaded yet
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_2.jpg not downloaded yet
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_5.jpg not downloaded yet
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637bb5b790>
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1989821-4004051-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1004.jpg saved to cache
2025-12-02 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_3.jpg not downloaded yet
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_4.jpg not downloaded yet
2025-12-02 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1798612-4003981-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-13.jpg not downloaded yet
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637890d510>
2025-12-02 08:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1989821-4004051-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1000.jpg saved to cache
2025-12-02 08:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637b9ce950>
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_7.jpg saved to cache
2025-12-02 08:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792db510>
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1989821-4004051-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1001.jpg saved to cache
2025-12-02 08:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1d6950>
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1989821-4004051-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1002.jpg saved to cache
2025-12-02 08:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637925ea50>
2025-12-02 08:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1989821-4004051-13.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-13.jpg saved to cache
2025-12-02 08:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379ba0e10>
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1989821-4004051-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1003.jpg saved to cache
2025-12-02 08:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a48e2d0>
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_expert_report_file_ada607a7-3da2-47d1-acd6-4523fb7b4845.pdf HTTP/1.1" 201 0
2025-12-02 08:02:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:02:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36fc41d9-ead6-5680-bfd0-7385ea3c0872, skipping ID generation
2025-12-02 08:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_7.jpg not downloaded yet
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637925d810>
2025-12-02 08:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1989821-4004051-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1005.jpg saved to cache
2025-12-02 08:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item db38ca89-4b9c-51b4-9d1d-4e831c058600
2025-12-02 08:02:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db38ca89-4b9c-51b4-9d1d-4e831c058600, skipping ID generation
2025-12-02 08:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item db38ca89-4b9c-51b4-9d1d-4e831c058600 from tracking dictionaries
2025-12-02 08:02:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db38ca89-4b9c-51b4-9d1d-4e831c058600 sending to next pipeline
2025-12-02 08:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: db38ca89-4b9c-51b4-9d1d-4e831c058600, identifier: 1989821
2025-12-02 08:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: db38ca89-4b9c-51b4-9d1d-4e831c058600 with identifier: 1989821
2025-12-02 08:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: db38ca89-4b9c-51b4-9d1d-4e831c058600 with identifier: 1989821
2025-12-02 08:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: db38ca89-4b9c-51b4-9d1d-4e831c058600 with identifier: 1989821 to the API
2025-12-02 08:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 08:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 08:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1005.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_expert_report_file_4a992ec2-af21-473b-98cb-cfcb60b42928.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001989821-01981900-003.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '1.2L',
'expiration_date': '2025-12-02T09:00:00Z',
'fuel_type': 'Petrol',
'id': 'db38ca89-4b9c-51b4-9d1d-4e831c058600',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KV18UJK',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/308?id=1989821',
'listing': 'auction',
'location': 'Bristol',
'make': 'PEUGEOT',
'model': '308',
'odometer': 52030,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 23,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179054,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179054,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178448,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238663,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 155071,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164981,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156647,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144643,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163537,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240064,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201802,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200816,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160825,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/ba2c75c3-d6a7-4aeb-855e-385261aff2b8_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289813,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239976,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233981,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277965,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315214,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139364,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1004.jpg',
'Width': 749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db38ca89-4b9c-51b4-9d1d-4e831c058600/db38ca89-4b9c-51b4-9d1d-4e831c058600_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312817,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1989821-4004051-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-03-29',
'seller_name': 'MotoNovo Finance',
'title': 'PEUGEOT 308 1.2 PureTech 130 Allure 5dr',
'transmission': 'manual',
'trim': '1.2 PureTech 130 Allure 5dr',
'year': 2018}
2025-12-02 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271989821%27 HTTP/1.1" 200 None
2025-12-02 08:02:39 [manheim.gb] INFO: Saving data for 1989821: {'created_time': 1764662559.949491, 'last_price_update_time': 1764662559.949503, 'auction_closing_time': 1764666000.0}
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1989821') HTTP/1.1" 204 0
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1798612-4003981-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1000.jpg not downloaded yet
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_7.jpg not downloaded yet
2025-12-02 08:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1798612-4003981-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1001.jpg not downloaded yet
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_6.jpg not downloaded yet
2025-12-02 08:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0c2150>
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_3.jpg saved to cache
2025-12-02 08:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a236490>
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_5.jpg saved to cache
2025-12-02 08:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bf9190>
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_6.jpg saved to cache
2025-12-02 08:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2a9390>
2025-12-02 08:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_7.jpg saved to cache
2025-12-02 08:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bfb110>
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1089633-4003813-13.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-13.jpg saved to cache
2025-12-02 08:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0c3dd0>
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_4.jpg saved to cache
2025-12-02 08:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1798612-4003981-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1002.jpg not downloaded yet
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_1.jpg not downloaded yet
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1798612-4003981-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1003.jpg not downloaded yet
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_5.jpg not downloaded yet
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0d8110>
2025-12-02 08:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_1.jpg saved to cache
2025-12-02 08:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0ceb50>
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_5.jpg saved to cache
2025-12-02 08:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a19add0>
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_4.jpg saved to cache
2025-12-02 08:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1798612-4003981-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1004.jpg not downloaded yet
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_4.jpg not downloaded yet
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1798612-4003981-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1005.jpg not downloaded yet
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_11.jpg not downloaded yet
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a173d90>
2025-12-02 08:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_2.jpg saved to cache
2025-12-02 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_10.jpg not downloaded yet
2025-12-02 08:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf> (referer: None)
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_9.jpg not downloaded yet
2025-12-02 08:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf> (referer: None)
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_2.jpg not downloaded yet
2025-12-02 08:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf> (referer: None)
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_5.jpg not downloaded yet
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_3.jpg not downloaded yet
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_4.jpg not downloaded yet
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1864706-4004064-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-13.jpg not downloaded yet
2025-12-02 08:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1c0850>
2025-12-02 08:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_expert_report_file_10f9b0a3-1a43-46b7-a310-e60c09eef16b.pdf HTTP/1.1" 201 0
2025-12-02 08:02:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e, skipping ID generation
2025-12-02 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_7.jpg not downloaded yet
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1864706-4004064-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1000.jpg not downloaded yet
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_7.jpg not downloaded yet
2025-12-02 08:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a5efe50>
2025-12-02 08:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_expert_report_file_762c9930-3037-44b2-b91b-b4bee8335272.pdf HTTP/1.1" 201 0
2025-12-02 08:02:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2876842-745d-59e6-b4ec-f2a23163a614, skipping ID generation
2025-12-02 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_7.jpg not downloaded yet
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1864706-4004064-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1001.jpg not downloaded yet
2025-12-02 08:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf> (referer: None)
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_6.jpg not downloaded yet
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_7.jpg not downloaded yet
2025-12-02 08:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792be3d0>
2025-12-02 08:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_expert_report_file_7d168ebc-bb17-44c2-ad5d-c8188205a9b2.pdf HTTP/1.1" 201 0
2025-12-02 08:02:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:02:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be58e6f6-2608-5d15-be6a-b49e5f011661, skipping ID generation
2025-12-02 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_7.jpg not downloaded yet
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1864706-4004064-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1002.jpg not downloaded yet
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_1.jpg not downloaded yet
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_6.jpg not downloaded yet
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_7.jpg not downloaded yet
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1864706-4004064-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1003.jpg not downloaded yet
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_5.jpg not downloaded yet
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_1.jpg not downloaded yet
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_6.jpg not downloaded yet
2025-12-02 08:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1f0610>
2025-12-02 08:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_expert_report_file_b100f09b-cb05-4594-a093-eb39232f6b3f.pdf HTTP/1.1" 201 0
2025-12-02 08:02:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:02:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2712f63-9d5d-5b54-8849-3e91022144b6, skipping ID generation
2025-12-02 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_7.jpg not downloaded yet
2025-12-02 08:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1864706-4004064-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1004.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_4.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_5.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_1.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_7.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1864706-4004064-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1005.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_11.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_4.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_5.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_6.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_10.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_11.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_4.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_1.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_9.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_10.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_11.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_5.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_2.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_9.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_10.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_4.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_5.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_2.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_9.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_11.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_3.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_5.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_2.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_10.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_4.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_3.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_5.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_9.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2091777-4003205-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1000.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_4.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_3.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_2.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2091777-4003205-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1001.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2058572-4002505-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-13.jpg not downloaded yet
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_4.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_5.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2091777-4003205-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1002.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2058572-4002505-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1000.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2057516-4004023-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-13.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_3.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2091777-4003205-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1003.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2058572-4002505-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1001.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2057516-4004023-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1000.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_4.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2091777-4003205-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1004.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2058572-4002505-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1002.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2057516-4004023-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1001.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2014140-4003008-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1000.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2091777-4003205-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1005.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2058572-4002505-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1003.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2057516-4004023-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1002.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2014140-4003008-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1001.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2091777-4003205-1006.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1006.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2058572-4002505-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1004.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2057516-4004023-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1003.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2014140-4003008-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1002.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2058572-4002505-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1005.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2057516-4004023-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1004.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2014140-4003008-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1003.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2057516-4004023-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1005.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2014140-4003008-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1004.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2014140-4003008-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1005.jpg not downloaded yet
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2014140-4003008-1006.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1006.jpg not downloaded yet
2025-12-02 08:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379203c50>
2025-12-02 08:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2057516-4004023-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1003.jpg saved to cache
2025-12-02 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a30efd0>
2025-12-02 08:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2057516-4004023-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1005.jpg saved to cache
2025-12-02 08:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bf8c50>
2025-12-02 08:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2058572-4002505-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1005.jpg saved to cache
2025-12-02 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a457290>
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2057516-4004023-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1004.jpg saved to cache
2025-12-02 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2f9050>
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2014140-4003008-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1002.jpg saved to cache
2025-12-02 08:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a01fe50>
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2057516-4004023-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1002.jpg saved to cache
2025-12-02 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2f9c10>
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2014140-4003008-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1001.jpg saved to cache
2025-12-02 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a42d950>
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2058572-4002505-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1004.jpg saved to cache
2025-12-02 08:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a342510>
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2014140-4003008-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1003.jpg saved to cache
2025-12-02 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a417910>
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2014140-4003008-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1004.jpg saved to cache
2025-12-02 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637890df90>
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2058572-4002505-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1003.jpg saved to cache
2025-12-02 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a417d90>
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2091777-4003205-1006.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1006.jpg saved to cache
2025-12-02 08:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a29ad90>
2025-12-02 08:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2091777-4003205-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1005.jpg saved to cache
2025-12-02 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1006.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792663d0>
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2014140-4003008-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1000.jpg saved to cache
2025-12-02 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792bd8d0>
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2058572-4002505-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1002.jpg saved to cache
2025-12-02 08:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792bff10>
2025-12-02 08:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2057516-4004023-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1000.jpg saved to cache
2025-12-02 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bac550>
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2091777-4003205-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1004.jpg saved to cache
2025-12-02 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2999d0>
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_4.jpg saved to cache
2025-12-02 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a45f6d0>
2025-12-02 08:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2057516-4004023-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1001.jpg saved to cache
2025-12-02 08:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a5ed1d0>
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2014140-4003008-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1005.jpg saved to cache
2025-12-02 08:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a17a090>
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2014140-4003008-1006.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1006.jpg saved to cache
2025-12-02 08:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1f45d0>
2025-12-02 08:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2058572-4002505-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1001.jpg saved to cache
2025-12-02 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379229310>
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2091777-4003205-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1003.jpg saved to cache
2025-12-02 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a03bad0>
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2058572-4002505-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1000.jpg saved to cache
2025-12-02 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bf4ed0>
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_3.jpg saved to cache
2025-12-02 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a264290>
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_4.jpg saved to cache
2025-12-02 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1c1a90>
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_5.jpg saved to cache
2025-12-02 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0c0090>
2025-12-02 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2091777-4003205-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1002.jpg saved to cache
2025-12-02 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a264910>
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2057516-4004023-13.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-13.jpg saved to cache
2025-12-02 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1f6bd0>
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2091777-4003205-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1001.jpg saved to cache
2025-12-02 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792da150>
2025-12-02 08:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_2.jpg saved to cache
2025-12-02 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637c1e46d0>
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2058572-4002505-13.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-13.jpg saved to cache
2025-12-02 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3e5b10>
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_9.jpg saved to cache
2025-12-02 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379216790>
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_4.jpg saved to cache
2025-12-02 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637926a350>
2025-12-02 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2091777-4003205-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1000.jpg saved to cache
2025-12-02 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1d4410>
2025-12-02 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_5.jpg saved to cache
2025-12-02 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0b2ed0>
2025-12-02 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_3.jpg saved to cache
2025-12-02 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a450bd0>
2025-12-02 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_4.jpg saved to cache
2025-12-02 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a432210>
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_10.jpg saved to cache
2025-12-02 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bfbf90>
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_3.jpg saved to cache
2025-12-02 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a01e950>
2025-12-02 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_2.jpg saved to cache
2025-12-02 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a266750>
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_3.jpg saved to cache
2025-12-02 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637923b190>
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_2.jpg saved to cache
2025-12-02 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a072d50>
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_11.jpg saved to cache
2025-12-02 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379201ed0>
2025-12-02 08:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_5.jpg saved to cache
2025-12-02 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2df790>
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_5.jpg saved to cache
2025-12-02 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a235a90>
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_9.jpg saved to cache
2025-12-02 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637924f910>
2025-12-02 08:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_10.jpg saved to cache
2025-12-02 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0c1e90>
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_4.jpg saved to cache
2025-12-02 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2dd150>
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_9.jpg saved to cache
2025-12-02 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637897b690>
2025-12-02 08:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_11.jpg saved to cache
2025-12-02 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a09fb90>
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_5.jpg saved to cache
2025-12-02 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a039610>
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_2.jpg saved to cache
2025-12-02 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3f6fd0>
2025-12-02 08:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_10.jpg saved to cache
2025-12-02 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a5d7610>
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_9.jpg saved to cache
2025-12-02 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0b26d0>
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_10.jpg saved to cache
2025-12-02 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a000a90>
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_11.jpg saved to cache
2025-12-02 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a108790>
2025-12-02 08:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_1.jpg saved to cache
2025-12-02 08:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a17abd0>
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_4.jpg saved to cache
2025-12-02 08:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3c0550>
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_6.jpg saved to cache
2025-12-02 08:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a01f450>
2025-12-02 08:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_5.jpg saved to cache
2025-12-02 08:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bb3fd0>
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_7.jpg saved to cache
2025-12-02 08:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a01f8d0>
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_11.jpg saved to cache
2025-12-02 08:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a47ec10>
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_4.jpg saved to cache
2025-12-02 08:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1f6b50>
2025-12-02 08:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_5.jpg saved to cache
2025-12-02 08:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a47e810>
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_1.jpg saved to cache
2025-12-02 08:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf)
2025-12-02 08:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a586c90>
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1864706-4004064-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1005.jpg saved to cache
2025-12-02 08:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2ba690>
2025-12-02 08:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_4.jpg saved to cache
2025-12-02 08:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637894b010>
2025-12-02 08:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_7.jpg saved to cache
2025-12-02 08:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2712f63-9d5d-5b54-8849-3e91022144b6
2025-12-02 08:03:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2712f63-9d5d-5b54-8849-3e91022144b6, skipping ID generation
2025-12-02 08:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f2712f63-9d5d-5b54-8849-3e91022144b6 from tracking dictionaries
2025-12-02 08:03:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2712f63-9d5d-5b54-8849-3e91022144b6 sending to next pipeline
2025-12-02 08:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f2712f63-9d5d-5b54-8849-3e91022144b6, identifier: 2014140
2025-12-02 08:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f2712f63-9d5d-5b54-8849-3e91022144b6 with identifier: 2014140
2025-12-02 08:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f2712f63-9d5d-5b54-8849-3e91022144b6 with identifier: 2014140
2025-12-02 08:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f2712f63-9d5d-5b54-8849-3e91022144b6 with identifier: 2014140 to the API
2025-12-02 08:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 08:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_expert_report_file_b100f09b-cb05-4594-a093-eb39232f6b3f.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002014140-01982404-003.pdf',
'color': 'GREY',
'currency': 'GBP',
'engine': '1.5L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Diesel',
'id': 'f2712f63-9d5d-5b54-8849-3e91022144b6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CE16WYR',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=2014140',
'listing': 'auction',
'location': 'Colchester',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 71203,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172247,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172247,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275560,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188178,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181275,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172415,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180382,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176522,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176520,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312771,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263861,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311224,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270802,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1df46571-e410-4b6e-9e5b-d658c34c7c35_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265498,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161030,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213291,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409284,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261349,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397386,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1005.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2712f63-9d5d-5b54-8849-3e91022144b6/f2712f63-9d5d-5b54-8849-3e91022144b6_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441484,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2014140-4003008-1006.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-03-26',
'seller_name': 'Stellantis & You',
'title': 'NISSAN JUKE 1.5 dCi Acenta 5dr',
'transmission': 'manual',
'trim': '1.5 dCi Acenta 5dr',
'year': 2016}
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272014140%27 HTTP/1.1" 200 None
2025-12-02 08:03:10 [manheim.gb] INFO: Saving data for 2014140: {'created_time': 1764662590.23373, 'last_price_update_time': 1764662590.233742, 'auction_closing_time': 1764838800.0}
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2014140') HTTP/1.1" 204 0
2025-12-02 08:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf)
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a432510>
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_1.jpg saved to cache
2025-12-02 08:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637893b450>
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_5.jpg saved to cache
2025-12-02 08:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a017450>
2025-12-02 08:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1864706-4004064-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1003.jpg saved to cache
2025-12-02 08:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a191f50>
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_6.jpg saved to cache
2025-12-02 08:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3ca610>
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1864706-4004064-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1004.jpg saved to cache
2025-12-02 08:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0ba050>
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_6.jpg saved to cache
2025-12-02 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1ae390>
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_1.jpg saved to cache
2025-12-02 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379ba1f50>
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_7.jpg saved to cache
2025-12-02 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a431410>
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_6.jpg saved to cache
2025-12-02 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637891eb50>
2025-12-02 08:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_7.jpg saved to cache
2025-12-02 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be58e6f6-2608-5d15-be6a-b49e5f011661
2025-12-02 08:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be58e6f6-2608-5d15-be6a-b49e5f011661, skipping ID generation
2025-12-02 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item be58e6f6-2608-5d15-be6a-b49e5f011661 from tracking dictionaries
2025-12-02 08:03:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be58e6f6-2608-5d15-be6a-b49e5f011661 sending to next pipeline
2025-12-02 08:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: be58e6f6-2608-5d15-be6a-b49e5f011661, identifier: 2057516
2025-12-02 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf)
2025-12-02 08:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: be58e6f6-2608-5d15-be6a-b49e5f011661 with identifier: 2057516
2025-12-02 08:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: be58e6f6-2608-5d15-be6a-b49e5f011661 with identifier: 2057516
2025-12-02 08:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: be58e6f6-2608-5d15-be6a-b49e5f011661 with identifier: 2057516 to the API
2025-12-02 08:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 08:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 08:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_expert_report_file_7d168ebc-bb17-44c2-ad5d-c8188205a9b2.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002057516-01987882-002.pdf',
'color': 'BLACK',
'currency': 'GBP',
'engine': '1.0L',
'expiration_date': '2025-12-08T09:00:00Z',
'fuel_type': 'Petrol',
'id': 'be58e6f6-2608-5d15-be6a-b49e5f011661',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA66AVZ',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/KIA/PICANTO?id=2057516',
'listing': 'auction',
'location': 'Leeds',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 18176,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 24,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217678,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217678,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315295,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183516,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178016,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185756,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179732,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185133,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197341,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230571,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380723,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361262,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 270764,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6fa17c4d-81f0-41a3-9cef-f636e907028b_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387496,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210490,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446855,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117002,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1002.jpg',
'Width': 749},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290874,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207369,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be58e6f6-2608-5d15-be6a-b49e5f011661/be58e6f6-2608-5d15-be6a-b49e5f011661_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423834,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2057516-4004023-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-09-12',
'seller_name': 'Big Motoring World Ltd',
'title': 'KIA PICANTO 1.0 65 SE 5dr',
'transmission': 'manual',
'trim': '1.0 65 SE 5dr',
'year': 2016}
2025-12-02 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272057516%27 HTTP/1.1" 200 None
2025-12-02 08:03:13 [manheim.gb] INFO: Saving data for 2057516: {'created_time': 1764662593.645106, 'last_price_update_time': 1764662593.645117, 'auction_closing_time': 1765184400.0}
2025-12-02 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2057516') HTTP/1.1" 204 0
2025-12-02 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf)
2025-12-02 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a238050>
2025-12-02 08:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_7.jpg saved to cache
2025-12-02 08:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a39dd90>
2025-12-02 08:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1864706-4004064-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1001.jpg saved to cache
2025-12-02 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a04d450>
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1864706-4004064-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1002.jpg saved to cache
2025-12-02 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637893aad0>
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_7.jpg saved to cache
2025-12-02 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a033410>
2025-12-02 08:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_7.jpg saved to cache
2025-12-02 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2876842-745d-59e6-b4ec-f2a23163a614
2025-12-02 08:03:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2876842-745d-59e6-b4ec-f2a23163a614, skipping ID generation
2025-12-02 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f2876842-745d-59e6-b4ec-f2a23163a614 from tracking dictionaries
2025-12-02 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2876842-745d-59e6-b4ec-f2a23163a614 sending to next pipeline
2025-12-02 08:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f2876842-745d-59e6-b4ec-f2a23163a614, identifier: 2058572
2025-12-02 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f2876842-745d-59e6-b4ec-f2a23163a614 with identifier: 2058572
2025-12-02 08:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f2876842-745d-59e6-b4ec-f2a23163a614 with identifier: 2058572
2025-12-02 08:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f2876842-745d-59e6-b4ec-f2a23163a614 with identifier: 2058572 to the API
2025-12-02 08:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 08:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 08:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 163,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_expert_report_file_762c9930-3037-44b2-b91b-b4bee8335272.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002058572-01614192-001.pdf',
'color': 'WHITE',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-10T09:00:00Z',
'fuel_type': 'Petrol',
'id': 'f2876842-745d-59e6-b4ec-f2a23163a614',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VA17FZV',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2058572',
'listing': 'auction',
'location': 'Leeds',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 63555,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198438,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198438,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194950,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170342,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192298,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180391,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180177,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166367,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184293,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186296,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199584,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243998,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215594,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/6a6174e7-e6d9-4019-bb19-fe3daa7b5741_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359095,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186592,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 207764,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156854,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222604,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233087,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2876842-745d-59e6-b4ec-f2a23163a614/f2876842-745d-59e6-b4ec-f2a23163a614_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151006,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2058572-4002505-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-23',
'seller_name': 'FCA Group',
'title': 'VOLKSWAGEN GOLF 2.0 TSI 310 R 5dr 4MOTION DSG',
'transmission': 'automatic',
'trim': '2.0 TSI 310 R 5dr 4MOTION DSG',
'year': 2017}
2025-12-02 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272058572%27 HTTP/1.1" 200 None
2025-12-02 08:03:16 [manheim.gb] INFO: Saving data for 2058572: {'created_time': 1764662596.823069, 'last_price_update_time': 1764662596.82308, 'auction_closing_time': 1765357200.0}
2025-12-02 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2058572') HTTP/1.1" 204 0
2025-12-02 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378994ad0>
2025-12-02 08:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fa01086ed-0db4-461d-88e0-ab173057f3e8_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_7.jpg saved to cache
2025-12-02 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e
2025-12-02 08:03:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e, skipping ID generation
2025-12-02 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e from tracking dictionaries
2025-12-02 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e sending to next pipeline
2025-12-02 08:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e, identifier: 2091777
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378988e10>
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_4.jpg saved to cache
2025-12-02 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378996ed0>
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_5.jpg saved to cache
2025-12-02 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378996810>
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_3.jpg saved to cache
2025-12-02 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378988ad0>
2025-12-02 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_2.jpg saved to cache
2025-12-02 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e with identifier: 2091777
2025-12-02 08:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e with identifier: 2091777
2025-12-02 08:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2025-12-02 08:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e spider: manheim.gb
2025-12-02 08:03:18 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_expert_report_file_10f9b0a3-1a43-46b7-a310-e60c09eef16b.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002091777-01989556-003.pdf',
'color': 'GREY',
'currency': 'GBP',
'engine': '1.6L',
'expiration_date': '2025-12-02T09:00:00Z',
'fuel_type': 'Diesel',
'id': '6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF15LKN',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A3?id=2091777',
'listing': 'auction',
'location': 'Manchester',
'make': 'AUDI',
'model': 'A3',
'odometer': 89971,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 33,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178257,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178257,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217184,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194562,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179193,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 180635,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172424,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174497,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176019,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242346,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 183277,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184773,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170995,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/a01086ed-0db4-461d-88e0-ab173057f3e8_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332246,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200706,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356139,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274718,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301549,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174058,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1005.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e/6ed3efae-cf6d-5fbe-8754-82d2a4b5e16e_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307679,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2091777-4003205-1006.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-16',
'seller_name': 'Fords Of Winsford LTD',
'title': 'AUDI A3 1.6 TDI 110 SE Technik 5dr',
'transmission': 'manual',
'trim': '1.6 TDI 110 SE Technik 5dr',
'year': 2015}
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272091777%27 HTTP/1.1" 200 None
2025-12-02 08:03:18 [manheim.gb] INFO: Saving data for 2091777: {'created_time': 1764662598.553361, 'last_price_update_time': 1764662598.553371, 'auction_closing_time': 1764666000.0}
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2091777') HTTP/1.1" 204 0
2025-12-02 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1d4350>
2025-12-02 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1864706-4004064-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1000.jpg saved to cache
2025-12-02 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2dd050>
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1864706-4004064-13.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-13.jpg saved to cache
2025-12-02 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a199050>
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_10.jpg saved to cache
2025-12-02 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2d5dd0>
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_9.jpg saved to cache
2025-12-02 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a433510>
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_4.jpg saved to cache
2025-12-02 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a19ac90>
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1798612-4003981-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1005.jpg saved to cache
2025-12-02 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2de810>
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_11.jpg saved to cache
2025-12-02 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf)
2025-12-02 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3948d0>
2025-12-02 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1798612-4003981-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1004.jpg saved to cache
2025-12-02 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0b1750>
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1798612-4003981-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1003.jpg saved to cache
2025-12-02 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637891fe90>
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_5.jpg saved to cache
2025-12-02 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2ba890>
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_1.jpg saved to cache
2025-12-02 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379201b10>
2025-12-02 08:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1798612-4003981-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1002.jpg saved to cache
2025-12-02 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a25ae50>
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_6.jpg saved to cache
2025-12-02 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a5eead0>
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_7.jpg saved to cache
2025-12-02 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378995350>
2025-12-02 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbfe3396-c17f-4a50-826f-3f2c7c533748_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_7.jpg saved to cache
2025-12-02 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872
2025-12-02 08:03:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36fc41d9-ead6-5680-bfd0-7385ea3c0872, skipping ID generation
2025-12-02 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 36fc41d9-ead6-5680-bfd0-7385ea3c0872 from tracking dictionaries
2025-12-02 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36fc41d9-ead6-5680-bfd0-7385ea3c0872 sending to next pipeline
2025-12-02 08:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 36fc41d9-ead6-5680-bfd0-7385ea3c0872, identifier: 1864706
2025-12-02 08:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2dc9d0>
2025-12-02 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_4.jpg saved to cache
2025-12-02 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-02 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 36fc41d9-ead6-5680-bfd0-7385ea3c0872 with identifier: 1864706
2025-12-02 08:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 36fc41d9-ead6-5680-bfd0-7385ea3c0872 with identifier: 1864706
2025-12-02 08:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153572 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153572
2025-12-02 08:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 36fc41d9-ead6-5680-bfd0-7385ea3c0872 spider: manheim.gb
2025-12-02 08:03:23 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 36fc41d9-ead6-5680-bfd0-7385ea3c0872 due to rule: high_mileage_for_country.json, error: 153572 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
153572
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_expert_report_file_ada607a7-3da2-47d1-acd6-4523fb7b4845.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001864706-01987356-002.pdf',
'color': 'BLUE',
'currency': 'GBP',
'engine': '1.2L',
'expiration_date': '2025-12-02T09:00:00Z',
'fuel_type': 'Petrol',
'id': '36fc41d9-ead6-5680-bfd0-7385ea3c0872',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CE10CNK',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=1864706',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 95426,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 29,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185868,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185868,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226266,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166257,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194749,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190339,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196307,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 190595,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192362,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243898,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218332,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211913,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217176,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbfe3396-c17f-4a50-826f-3f2c7c533748_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348082,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332111,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318992,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269167,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242260,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416824,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36fc41d9-ead6-5680-bfd0-7385ea3c0872/36fc41d9-ead6-5680-bfd0-7385ea3c0872_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 486576,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1864706-4004064-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-03-31',
'seller_name': 'OMC Ford',
'title': 'FORD FIESTA 1.25 Edge 5dr [82]',
'transmission': 'manual',
'trim': '1.25 Edge 5dr [82]',
'year': 2010}
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271864706%27 HTTP/1.1" 200 None
2025-12-02 08:03:23 [manheim.gb] INFO: Saving data for 1864706: {'created_time': 1764662603.775296, 'last_price_update_time': 1764662603.775306, 'auction_closing_time': 1764666000.0}
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1864706') HTTP/1.1" 204 0
2025-12-02 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf)
2025-12-02 08:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a02a590>
2025-12-02 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1798612-4003981-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1001.jpg saved to cache
2025-12-02 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a000e50>
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1798612-4003981-13.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-13.jpg saved to cache
2025-12-02 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a219290>
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1798612-4003981-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1000.jpg saved to cache
2025-12-02 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1d6f90>
2025-12-02 08:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_5.jpg saved to cache
2025-12-02 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637894b810>
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_3.jpg saved to cache
2025-12-02 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a033610>
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_9.jpg saved to cache
2025-12-02 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a39fe90>
2025-12-02 08:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_2.jpg saved to cache
2025-12-02 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a5a15d0>
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_9.jpg saved to cache
2025-12-02 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637bb35a10>
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_10.jpg saved to cache
2025-12-02 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2bbb90>
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_10.jpg saved to cache
2025-12-02 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0161d0>
2025-12-02 08:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_11.jpg saved to cache
2025-12-02 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a23bf90>
2025-12-02 08:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fbbdf6fe2-8e18-4f60-a315-9bcb943feba0_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_11.jpg saved to cache
2025-12-02 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a
2025-12-02 08:03:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06d87df0-6aef-5d6d-8442-100ba6aaef5a, skipping ID generation
2025-12-02 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 06d87df0-6aef-5d6d-8442-100ba6aaef5a from tracking dictionaries
2025-12-02 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06d87df0-6aef-5d6d-8442-100ba6aaef5a sending to next pipeline
2025-12-02 08:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 06d87df0-6aef-5d6d-8442-100ba6aaef5a, identifier: 1798612
2025-12-02 08:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 06d87df0-6aef-5d6d-8442-100ba6aaef5a with identifier: 1798612
2025-12-02 08:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 06d87df0-6aef-5d6d-8442-100ba6aaef5a with identifier: 1798612
2025-12-02 08:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2025-12-02 08:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 06d87df0-6aef-5d6d-8442-100ba6aaef5a spider: manheim.gb
2025-12-02 08:03:28 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 06d87df0-6aef-5d6d-8442-100ba6aaef5a due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_expert_report_file_6e9cb9b7-2273-4e71-bc92-3b68873b585a.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001798612-01990477-002.pdf',
'color': 'WHITE',
'currency': 'GBP',
'engine': '1.2L',
'expiration_date': '2025-12-04T09:00:00Z',
'fuel_type': 'Petrol',
'id': '06d87df0-6aef-5d6d-8442-100ba6aaef5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NA15LXP',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/NOTE?id=1798612',
'listing': 'auction',
'location': 'Shotts',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 76768,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 31,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243376,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243376,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241362,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250379,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248128,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239020,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241786,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237481,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246520,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312361,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188189,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216913,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230832,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/bbdf6fe2-8e18-4f60-a315-9bcb943feba0_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 266658,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305842,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265024,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279558,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 143934,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121427,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06d87df0-6aef-5d6d-8442-100ba6aaef5a/06d87df0-6aef-5d6d-8442-100ba6aaef5a_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204500,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1798612-4003981-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-05-08',
'seller_name': 'Oplo CF Limited',
'title': 'NISSAN NOTE 1.2 Acenta 5dr',
'transmission': 'manual',
'trim': '1.2 Acenta 5dr',
'year': 2015}
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271798612%27 HTTP/1.1" 200 None
2025-12-02 08:03:28 [manheim.gb] INFO: Saving data for 1798612: {'created_time': 1764662608.034241, 'last_price_update_time': 1764662608.03425, 'auction_closing_time': 1764838800.0}
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1798612') HTTP/1.1" 204 0
2025-12-02 08:03:28 [scrapy.extensions.logstats] INFO: Crawled 40 pages (at 10 pages/min), scraped 6 items (at 4 items/min)
2025-12-02 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf)
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a4f4850>
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_5.jpg saved to cache
2025-12-02 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bb2790>
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_4.jpg saved to cache
2025-12-02 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792f5610>
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_1.jpg saved to cache
2025-12-02 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0140d0>
2025-12-02 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_7.jpg saved to cache
2025-12-02 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bb0710>
2025-12-02 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_6.jpg saved to cache
2025-12-02 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0b1f50>
2025-12-02 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_7.jpg saved to cache
2025-12-02 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b
2025-12-02 08:03:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a04e308-c753-5b7d-89c8-d047b0e6ac8b, skipping ID generation
2025-12-02 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b from tracking dictionaries
2025-12-02 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a04e308-c753-5b7d-89c8-d047b0e6ac8b sending to next pipeline
2025-12-02 08:03:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0a04e308-c753-5b7d-89c8-d047b0e6ac8b, identifier: 1089633
2025-12-02 08:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0a04e308-c753-5b7d-89c8-d047b0e6ac8b with identifier: 1089633
2025-12-02 08:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0a04e308-c753-5b7d-89c8-d047b0e6ac8b with identifier: 1089633
2025-12-02 08:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
2025-12-02 08:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 0a04e308-c753-5b7d-89c8-d047b0e6ac8b spider: manheim.gb
2025-12-02 08:03:29 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 0a04e308-c753-5b7d-89c8-d047b0e6ac8b due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
{'maximum': 9, 'type': 'number'}
On instance['current_year_diff']:
10
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_expert_report_file_a93caff6-1265-46d8-93f2-17eb453d05a8.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001089633-01989199-002.pdf',
'color': 'GREY',
'currency': 'GBP',
'engine': '1.0L',
'expiration_date': '2025-12-03T09:00:00Z',
'fuel_type': 'Petrol',
'id': '0a04e308-c753-5b7d-89c8-d047b0e6ac8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YR65VKG',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=1089633',
'listing': 'auction',
'location': 'Birmingham',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 41791,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 21,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219044,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219044,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_7.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253790,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217946,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 213500,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_5.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220915,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_4.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205993,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_11.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214015,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_10.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222274,
'Height': 999,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_9.jpg',
'Width': 1500},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220463,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195828,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179887,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195155,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/4830e59c-2a37-4f9b-9fb7-d804c04bf2ff_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279093,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265876,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 191020,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239373,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226229,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290364,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0a04e308-c753-5b7d-89c8-d047b0e6ac8b/0a04e308-c753-5b7d-89c8-d047b0e6ac8b_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 226852,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1089633-4003813-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-11-11',
'seller_name': 'Available Car',
'title': 'FORD FIESTA 1.0 Titanium 5dr',
'transmission': 'manual',
'trim': '1.0 Titanium 5dr',
'year': 2015}
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271089633%27 HTTP/1.1" 200 None
2025-12-02 08:03:29 [manheim.gb] INFO: Saving data for 1089633: {'created_time': 1764662609.92542, 'last_price_update_time': 1764662609.92543, 'auction_closing_time': 1764752400.0}
2025-12-02 08:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1089633') HTTP/1.1" 204 0
2025-12-02 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf> (referer: None)
2025-12-02 08:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a3ee9d0>
2025-12-02 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_expert_report_file_35001239-544c-4a7f-8726-640d14a94672.pdf HTTP/1.1" 201 0
2025-12-02 08:03:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22959678-4c66-5fb6-9bf6-12e1cd091a9f, skipping ID generation
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_7.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_7.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_6.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_1.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_5.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_4.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_11.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_10.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_9.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_2.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_5.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_3.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_4.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1317459-4003851-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-13.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1317459-4003851-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1000.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1317459-4003851-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1001.jpg not downloaded yet
2025-12-02 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1317459-4003851-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1002.jpg not downloaded yet
2025-12-02 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1317459-4003851-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1003.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1317459-4003851-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1004.jpg not downloaded yet
2025-12-02 08:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1317459-4003851-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1005.jpg not downloaded yet
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637895c490>
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_7.jpg saved to cache
2025-12-02 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637895c310>
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_7.jpg saved to cache
2025-12-02 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379ba1150>
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_5.jpg saved to cache
2025-12-02 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a598090>
2025-12-02 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_11.jpg saved to cache
2025-12-02 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637894a150>
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_6.jpg saved to cache
2025-12-02 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a02b9d0>
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_4.jpg saved to cache
2025-12-02 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1d4a90>
2025-12-02 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_10.jpg saved to cache
2025-12-02 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a028850>
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_9.jpg saved to cache
2025-12-02 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a59aad0>
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_1.jpg saved to cache
2025-12-02 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a59ae90>
2025-12-02 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-02 08:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_2.jpg saved to cache
2025-12-02 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a4a0150>
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1317459-4003851-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1002.jpg saved to cache
2025-12-02 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a35f550>
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1317459-4003851-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1005.jpg saved to cache
2025-12-02 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378995f10>
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_5.jpg saved to cache
2025-12-02 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a10a610>
2025-12-02 08:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_3.jpg saved to cache
2025-12-02 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637925d810>
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_4.jpg saved to cache
2025-12-02 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a04c990>
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1317459-4003851-13.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-13.jpg saved to cache
2025-12-02 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6379bd7c10>
2025-12-02 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1317459-4003851-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1001.jpg saved to cache
2025-12-02 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a0b81d0>
2025-12-02 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1317459-4003851-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1000.jpg saved to cache
2025-12-02 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf)
2025-12-02 08:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63789399d0>
2025-12-02 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1317459-4003851-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1004.jpg saved to cache
2025-12-02 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1cc050>
2025-12-02 08:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-1317459-4003851-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1003.jpg saved to cache
2025-12-02 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f
2025-12-02 08:03:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22959678-4c66-5fb6-9bf6-12e1cd091a9f, skipping ID generation
2025-12-02 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 22959678-4c66-5fb6-9bf6-12e1cd091a9f from tracking dictionaries
2025-12-02 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22959678-4c66-5fb6-9bf6-12e1cd091a9f sending to next pipeline
2025-12-02 08:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 22959678-4c66-5fb6-9bf6-12e1cd091a9f, identifier: 1317459
2025-12-02 08:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 22959678-4c66-5fb6-9bf6-12e1cd091a9f with identifier: 1317459
2025-12-02 08:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 22959678-4c66-5fb6-9bf6-12e1cd091a9f with identifier: 1317459
2025-12-02 08:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 185006 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
185006
2025-12-02 08:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 22959678-4c66-5fb6-9bf6-12e1cd091a9f spider: manheim.gb
2025-12-02 08:03:39 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 22959678-4c66-5fb6-9bf6-12e1cd091a9f due to rule: high_mileage_for_country.json, error: 185006 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
185006
{'auction_title': '',
'c_o_2_emission_value': 122,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_expert_report_file_35001239-544c-4a7f-8726-640d14a94672.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001317459-01987754-003.pdf',
'color': 'GREY',
'currency': 'GBP',
'engine': '2.0L',
'expiration_date': '2025-12-02T09:00:00Z',
'fuel_type': 'Diesel',
'id': '22959678-4c66-5fb6-9bf6-12e1cd091a9f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HJ15NWL',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/3%20SERIES?id=1317459',
'listing': 'auction',
'location': 'Northampton',
'make': 'BMW',
'model': '3 SERIES',
'odometer': 114958,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 25,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225328,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225328,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273068,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205588,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215736,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 219104,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 215691,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216208,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217438,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288118,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 246963,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239180,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225114,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/0d6e6e88-2d34-4ef2-b5eb-7fbed9c28ef8_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296054,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342377,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285325,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189341,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337638,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277854,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22959678-4c66-5fb6-9bf6-12e1cd091a9f/22959678-4c66-5fb6-9bf6-12e1cd091a9f_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193702,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-1317459-4003851-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-03-31',
'seller_name': 'Wollaston',
'title': 'BMW 3 SERIES 325d M Sport 4dr Step Auto',
'transmission': 'automatic',
'trim': '325d M Sport 4dr Step Auto',
'year': 2015}
2025-12-02 08:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271317459%27 HTTP/1.1" 200 None
2025-12-02 08:03:40 [manheim.gb] INFO: Saving data for 1317459: {'created_time': 1764662620.002206, 'last_price_update_time': 1764662620.002216, 'auction_closing_time': 1764666000.0}
2025-12-02 08:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1317459') HTTP/1.1" 204 0
2025-12-02 08:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/JEEP/COMPASS?id=2044428&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232044428&indx=78> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-02 08:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ddd3c60-4b9c-535b-8351-04bf048bca18 with identifier: 2044428
2025-12-02 08:04:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf> (referer: None)
2025-12-02 08:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637bb2f290>
2025-12-02 08:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_expert_report_file_088de861-75c0-448c-b6c7-a38ed7dfa680.pdf HTTP/1.1" 201 0
2025-12-02 08:04:03 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ddd3c60-4b9c-535b-8351-04bf048bca18, skipping ID generation
2025-12-02 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_7.jpg not downloaded yet
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_7.jpg not downloaded yet
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_6.jpg not downloaded yet
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_1.jpg not downloaded yet
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_5.jpg not downloaded yet
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_4.jpg not downloaded yet
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_11.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_11.jpg not downloaded yet
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_10.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_10.jpg not downloaded yet
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_9.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_9.jpg not downloaded yet
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_2.jpg not downloaded yet
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_5.jpg not downloaded yet
2025-12-02 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_3.jpg not downloaded yet
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_4.jpg not downloaded yet
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2044428-4003589-13.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-13.jpg not downloaded yet
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2044428-4003589-1000.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1000.jpg not downloaded yet
2025-12-02 08:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2044428-4003589-1001.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1001.jpg not downloaded yet
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2044428-4003589-1002.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1002.jpg not downloaded yet
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2044428-4003589-1003.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1003.jpg not downloaded yet
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2044428-4003589-1004.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1004.jpg not downloaded yet
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2044428-4003589-1005.jpg%27 HTTP/1.1" 200 None
2025-12-02 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1005.jpg not downloaded yet
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792cf3d0>
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_0.jpg HTTP/1.1" 201 0
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_7.jpg saved to cache
2025-12-02 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637922fdd0>
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_4.jpg HTTP/1.1" 201 0
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_5.jpg saved to cache
2025-12-02 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a45c090>
2025-12-02 08:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_7.jpg HTTP/1.1" 201 0
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_10.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_10.jpg saved to cache
2025-12-02 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a472a90>
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_2.jpg HTTP/1.1" 201 0
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_6.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_6.jpg saved to cache
2025-12-02 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a028f10>
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_6.jpg HTTP/1.1" 201 0
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_11.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_11.jpg saved to cache
2025-12-02 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1d7f50>
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_5.jpg HTTP/1.1" 201 0
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_4.jpg saved to cache
2025-12-02 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a1c1dd0>
2025-12-02 08:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_1.jpg HTTP/1.1" 201 0
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_7.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_7.jpg saved to cache
2025-12-02 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637891dcd0>
2025-12-02 08:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_3.jpg HTTP/1.1" 201 0
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_1.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_1.jpg saved to cache
2025-12-02 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a35f190>
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_8.jpg HTTP/1.1" 201 0
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_9.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_9.jpg saved to cache
2025-12-02 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637895ce90>
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_11.jpg HTTP/1.1" 201 0
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_3.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_3.jpg saved to cache
2025-12-02 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63789987d0>
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_10.jpg HTTP/1.1" 201 0
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_5.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_5.jpg saved to cache
2025-12-02 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a249a90>
2025-12-02 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_12.jpg HTTP/1.1" 201 0
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_4.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_4.jpg saved to cache
2025-12-02 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378938550>
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_9.jpg HTTP/1.1" 201 0
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F140c2c55-8d40-44ab-9b87-7586b53d012b_ext_2.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_2.jpg saved to cache
2025-12-02 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f6378939dd0>
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_14.jpg HTTP/1.1" 201 0
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2044428-4003589-1000.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1000.jpg saved to cache
2025-12-02 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f63792cd590>
2025-12-02 08:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_13.jpg HTTP/1.1" 201 0
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2044428-4003589-13.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-13.jpg saved to cache
2025-12-02 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a23a3d0>
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_15.jpg HTTP/1.1" 201 0
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2044428-4003589-1001.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1001.jpg saved to cache
2025-12-02 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf)
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a2d5d10>
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_19.jpg HTTP/1.1" 201 0
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2044428-4003589-1005.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1005.jpg saved to cache
2025-12-02 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a09f350>
2025-12-02 08:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_16.jpg HTTP/1.1" 201 0
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2044428-4003589-1002.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1002.jpg saved to cache
2025-12-02 08:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a41c990>
2025-12-02 08:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_18.jpg HTTP/1.1" 201 0
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2044428-4003589-1004.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1004.jpg saved to cache
2025-12-02 08:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-02 08:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-02 08:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-02 08:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f637a384550>
2025-12-02 08:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-02 08:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_17.jpg HTTP/1.1" 201 0
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-2044428-4003589-1003.jpg') HTTP/1.1" 204 0
2025-12-02 08:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1003.jpg saved to cache
2025-12-02 08:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 8ddd3c60-4b9c-535b-8351-04bf048bca18
2025-12-02 08:04:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ddd3c60-4b9c-535b-8351-04bf048bca18, skipping ID generation
2025-12-02 08:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8ddd3c60-4b9c-535b-8351-04bf048bca18 from tracking dictionaries
2025-12-02 08:04:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ddd3c60-4b9c-535b-8351-04bf048bca18 sending to next pipeline
2025-12-02 08:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8ddd3c60-4b9c-535b-8351-04bf048bca18, identifier: 2044428
2025-12-02 08:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8ddd3c60-4b9c-535b-8351-04bf048bca18 with identifier: 2044428
2025-12-02 08:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8ddd3c60-4b9c-535b-8351-04bf048bca18 with identifier: 2044428
2025-12-02 08:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 8ddd3c60-4b9c-535b-8351-04bf048bca18 with identifier: 2044428 to the API
2025-12-02 08:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-02 08:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-02 08:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1003.jpg>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_expert_report_file_088de861-75c0-448c-b6c7-a38ed7dfa680.pdf',
'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002044428-01986796-003.pdf',
'color': 'WHITE',
'currency': 'GBP',
'engine': '1.4L',
'expiration_date': '2025-12-08T09:00:00Z',
'fuel_type': 'Petrol',
'id': '8ddd3c60-4b9c-535b-8351-04bf048bca18',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CY18UDX',
'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/JEEP/COMPASS?id=2044428',
'listing': 'auction',
'location': 'Colchester',
'make': 'JEEP',
'model': 'COMPASS',
'odometer': 68336,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233354,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 233354,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_7.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209311,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_6.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149804,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_1.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 223373,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 220123,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196805,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_11.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192210,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_10.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188062,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_9.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216958,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_2.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_10.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164983,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_5.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_11.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164821,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_3.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_12.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173481,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/140c2c55-8d40-44ab-9b87-7586b53d012b_ext_4.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_13.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329756,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-13.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_14.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210601,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1000.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_15.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389431,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1001.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_16.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175601,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1002.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_17.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338417,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1003.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_18.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193205,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1004.jpg',
'Width': 1333},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ddd3c60-4b9c-535b-8351-04bf048bca18/8ddd3c60-4b9c-535b-8351-04bf048bca18_image_19.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149934,
'Height': 1000,
'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-2044428-4003589-1005.jpg',
'Width': 1333}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-22',
'seller_name': 'FCA Group',
'title': 'JEEP COMPASS 1.4 Multiair 140 Longitude 5dr [2WD]',
'transmission': 'manual',
'trim': '1.4 Multiair 140 Longitude 5dr [2WD]',
'year': 2018}
2025-12-02 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272044428%27 HTTP/1.1" 200 None
2025-12-02 08:04:11 [manheim.gb] INFO: Saving data for 2044428: {'created_time': 1764662651.491045, 'last_price_update_time': 1764662651.491056, 'auction_closing_time': 1765184400.0}
2025-12-02 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2044428') HTTP/1.1" 204 0
2025-12-02 08:04:11 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-02 08:04:11 [manheim.gb] INFO: manheim.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2025-12-02 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272143331%27 HTTP/1.1" 200 None
2025-12-02 08:04:11 [manheim.gb] INFO: Saving data for 2143331: {'created_time': 1764662651.627834}
2025-12-02 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2143331') HTTP/1.1" 204 0
2025-12-02 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-02 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20last_price_update_time%20lt%201764230651 HTTP/1.1" 200 None
2025-12-02 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='manheim.gb',RowKey='1064890') HTTP/1.1" 204 0
2025-12-02 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='manheim.gb',RowKey='1099356') HTTP/1.1" 204 0
2025-12-02 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='manheim.gb',RowKey='1146365') HTTP/1.1" 204 0
2025-12-02 08:04:11 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (7 items) in: file:///var/lib/scrapyd/items/sourcing_v2/manheim.gb/task_37_2025-12-02T08_00_03.jl
2025-12-02 08:04:11 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 461979,
'downloader/request_count': 373,
'downloader/request_method_count/GET': 372,
'downloader/request_method_count/POST': 1,
'downloader/response_bytes': 137978140,
'downloader/response_count': 373,
'downloader/response_status_count/200': 373,
'elapsed_time_seconds': 224.972133,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2025, 12, 2, 8, 4, 11, 734279, tzinfo=datetime.timezone.utc),
'item_dropped_count': 13,
'item_dropped_reasons_count/DropItem': 13,
'item_scraped_count': 7,
'log_count/DEBUG': 4062,
'log_count/ERROR': 8,
'log_count/INFO': 3585,
'memusage/max': 202162176,
'memusage/startup': 127324160,
'photo_download_count': 333,
'playwright/context_count': 1,
'playwright/context_count/max_concurrent': 1,
'playwright/context_count/persistent/False': 1,
'playwright/context_count/remote/False': 1,
'playwright/page_count': 1,
'playwright/page_count/max_concurrent': 1,
'playwright/request_count': 87,
'playwright/request_count/aborted': 47,
'playwright/request_count/method/GET': 84,
'playwright/request_count/method/POST': 3,
'playwright/request_count/navigation': 4,
'playwright/request_count/resource_type/document': 4,
'playwright/request_count/resource_type/font': 8,
'playwright/request_count/resource_type/image': 41,
'playwright/request_count/resource_type/script': 24,
'playwright/request_count/resource_type/stylesheet': 8,
'playwright/request_count/resource_type/xhr': 2,
'playwright/response_count': 40,
'playwright/response_count/method/GET': 37,
'playwright/response_count/method/POST': 3,
'playwright/response_count/resource_type/document': 4,
'playwright/response_count/resource_type/font': 8,
'playwright/response_count/resource_type/script': 18,
'playwright/response_count/resource_type/stylesheet': 8,
'playwright/response_count/resource_type/xhr': 2,
'request_depth_max': 4,
'response_received_count': 40,
'scheduler/dequeued': 373,
'scheduler/dequeued/memory': 373,
'scheduler/enqueued': 373,
'scheduler/enqueued/memory': 373,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 21,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 29.911844781322756,
'scrapy-zyte-api/mean_response_seconds': 30.18642737305102,
'scrapy-zyte-api/processed': 21,
'scrapy-zyte-api/request_args/actions': 20,
'scrapy-zyte-api/request_args/browserHtml': 20,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 1,
'scrapy-zyte-api/request_args/experimental.requestCookies': 21,
'scrapy-zyte-api/request_args/experimental.responseCookies': 21,
'scrapy-zyte-api/request_args/httpRequestBody': 1,
'scrapy-zyte-api/request_args/httpRequestMethod': 1,
'scrapy-zyte-api/request_args/httpResponseBody': 1,
'scrapy-zyte-api/request_args/httpResponseHeaders': 1,
'scrapy-zyte-api/request_args/requestHeaders': 20,
'scrapy-zyte-api/request_args/sessionContext': 20,
'scrapy-zyte-api/request_args/url': 21,
'scrapy-zyte-api/status_codes/200': 21,
'scrapy-zyte-api/success': 21,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'spider_exceptions/ValueError': 1,
'start_time': datetime.datetime(2025, 12, 2, 8, 0, 26, 762146, tzinfo=datetime.timezone.utc)}
2025-12-02 08:04:11 [scrapy.core.engine] INFO: Spider closed (finished)