2025-12-04 08:00:20 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-04 08:00:20 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-04 08:00:20 [manheim.gb] INFO: Starting spider manheim.gb
2025-12-04 08:00:20 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-04 08:00:20 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-04 08:00:20 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-04 08:00:20 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-04 08:00:20 [scrapy.extensions.telnet] INFO: Telnet Password: 23945c673e9a8cef
2025-12-04 08:00:20 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-04 08:00:20 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/manheim.gb/task_37_2025-12-04T08_00_02.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-04 08:00:20 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-04 08:00:20 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-04 08:00:20 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-04 08:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-04 08:00:20 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-04 08:00:20 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2025-12-04 08:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:00:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 08:00:20 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-04 08:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-04 08:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:20 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-04 08:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-04 08:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-04 08:00:20 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-04 08:00:20 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-04 08:00:20 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-04 08:00:20 [scrapy.core.engine] INFO: Spider opened
2025-12-04 08:00:20 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-04 08:00:20 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2025-12-04 08:00:20 [scrapy-playwright] INFO: Starting download handler
2025-12-04 08:00:20 [scrapy-playwright] INFO: Starting download handler
2025-12-04 08:00:25 [scrapy-playwright] INFO: Launching browser firefox
2025-12-04 08:00:26 [scrapy-playwright] INFO: Browser firefox launched
2025-12-04 08:00:26 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2025-12-04 08:00:28 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2025-12-04 08:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-04 08:00:28 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://www.manheim.co.uk/>
2025-12-04 08:00:28 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/> (resource type: document)
2025-12-04 08:00:30 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/>
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:31 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/homepage?v=CIpuZXIp0V7i0j1sjTB9sUemSg9-D9w8k891UP0sReI1>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/top_navigationlogo.ashx?la=en>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/homepage_new.ashx?la=en>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-c114-treated--hero.ashx?la=en&mw=960>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2021/vehicle-solutions/vs-3.ashx?la=en&mw=960>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/inspections-and-collections/inspections-and-collections-b87-treated---hero.ashx?la=en&mw=960>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/filters/dot_pattern.png>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/buying-options/buying-options-c153-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/buying-options/buying-options-c153-treated--hero.ashx?la=en&mw=1920>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/manheimcolchester10.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/manheimcolchester10.ashx?la=en&mw=1920>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920> (resource type: image, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/new-website-images-2023/auction-centre-pages/auction-centre-8665-treated--hero.ashx?la=en&mw=1920>
2025-12-04 08:00:32 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-04 08:00:33 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-04 08:00:33 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-04 08:00:33 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-04 08:00:33 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-04 08:00:33 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:33 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-04 08:00:33 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:33 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:33 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-04 08:00:35 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-04 08:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:35 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=&visitor_id_sign=&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-04 08:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918889887&visitor_id_sign=7c5ddd5400730ffd0cd7ff6a45d6203298c4ba7185e109bbe8b19c56b08c2bcc82ee95b93add4db03d012a32f42cab9d409dface&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:37 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918889887&visitor_id_sign=7c5ddd5400730ffd0cd7ff6a45d6203298c4ba7185e109bbe8b19c56b08c2bcc82ee95b93add4db03d012a32f42cab9d409dface&pi_opt_in=&campaign_id=24684&account_id=38592&title=Manheim%20%7C%20Auctions%2C%20Vehicle%20Solutions%20%26%20Remarketing&url=https%3A%2F%2Fwww.manheim.co.uk%2F&referrer=>
2025-12-04 08:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/account/login> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/account/login> (location: /mymanheim/dashboard)
2025-12-04 08:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/mymanheim/dashboard> (resource type: document, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:46 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/mymanheim/dashboard>
2025-12-04 08:00:46 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:46 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:46 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/SignalR/Hubs> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/myManheim.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Content/dashboards.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1>
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/SignalR/Hubs>
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/core-blessed1.min.css> (resource type: stylesheet, referrer: https://www.manheim.co.uk/assets/css/bundle?v=HcGNblHj64wK-Istb_0SemQAL-rwtK13kDPW8q3LCIo1)
2025-12-04 08:00:47 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/delete/scripts/postlogin?v=Bwe963dGqUB3Sdny8E3tKSL2gV9GDgLwX1g6Gq6KF-A1>
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <302 https://www.manheim.co.uk/Scripts/jquery-ui-1.12.1.js> (location: https://www.manheim.co.uk/404)
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/bundles/simulcast?v=P7s0oLmuXc3p3WQNs8URnZ4NaK3K6qkWLOwf0uOs5gw1>
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/tellnumberchange.js>
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Scripts/Manheim/RemoveSignUpBanner.js>
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/jquery-ui-1.13.2.min.css>
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/404> (resource type: script, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/core-blessed1.min.css>
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/myManheim.css>
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Content/dashboards.css>
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimwhitecoxautomotive3.ashx?la=en>
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.googletagmanager.com/gtm.js?id=GTM-KZS96H>
2025-12-04 08:00:50 [scrapy-playwright] DEBUG: [Context=default] Response: <404 https://www.manheim.co.uk/404>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/new-manheim-booking.ashx?la=en>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/blog/2025/gavel_2025.ashx?h=176&la=en&w=210&crop=1>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/img_6251.ashx?h=176&la=en&w=210&crop=1>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/payg1.ashx?la=en>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/v3--design11918banner535x191px-(1).ashx?la=en>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/campaigns/nama/nama-lcv-location-banner.ashx?la=en>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/movex/why_pay_more.ashx?la=en>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/images/banners-and-adverts/products-services/simulcast_banner.ashx?la=en>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimlogofooter2.ashx?la=en>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/~/media/manheimlogos/manheimvehiclesearchpage2.ashx?la=en>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png> (resource type: image, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/branding/dropdown.png>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff> (resource type: font, referrer: https://www.manheim.co.uk/assets/css/core-blessed1.min.css)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif> (resource type: image, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://www.manheim.co.uk/assets/images/thickbox/loadingAnimation.gif>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://www.manheim.co.uk/Account/IsCookieExist> (resource type: xhr, referrer: https://www.manheim.co.uk/mymanheim/dashboard)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Light.woff>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Regular.woff>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Manheim-Icons/Manheim-Icons.woff>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/assets/css/fonts/Lato/Lato-Bold.woff>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.manheim.co.uk/Account/IsCookieExist>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:51 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://js-agent.newrelic.com/nr-spa-1.303.0.min.js>
2025-12-04 08:00:52 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-04 08:00:52 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/analytics?ver=3&visitor_id=918889887&visitor_id_sign=7c5ddd5400730ffd0cd7ff6a45d6203298c4ba7185e109bbe8b19c56b08c2bcc82ee95b93add4db03d012a32f42cab9d409dface&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:53 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/analytics?ver=3&visitor_id=918889887&visitor_id_sign=7c5ddd5400730ffd0cd7ff6a45d6203298c4ba7185e109bbe8b19c56b08c2bcc82ee95b93add4db03d012a32f42cab9d409dface&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-04 08:00:53 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918889887&visitor_id_sign=7c5ddd5400730ffd0cd7ff6a45d6203298c4ba7185e109bbe8b19c56b08c2bcc82ee95b93add4db03d012a32f42cab9d409dface&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F> (resource type: script, referrer: https://www.manheim.co.uk/)
2025-12-04 08:00:54 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://brands.coxauto.co.uk/analytics?conly=true&visitor_id=918889887&visitor_id_sign=7c5ddd5400730ffd0cd7ff6a45d6203298c4ba7185e109bbe8b19c56b08c2bcc82ee95b93add4db03d012a32f42cab9d409dface&pi_opt_in=&campaign_id=24684&account_id=38592&title=Dashboard%20%7C%20Manheim&url=https%3A%2F%2Fwww.manheim.co.uk%2Fmymanheim%2Fdashboard&referrer=https%3A%2F%2Fwww.manheim.co.uk%2F>
2025-12-04 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk> (referer: None) ['playwright']
2025-12-04 08:00:56 [manheim.gb] INFO: Cookies from Playwright: [{'name': 'ASP.NET_SessionId', 'value': '5jea1fs2cb4hjdgzw0xaqxjt', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'Lax'}, {'name': '__RequestVerificationToken', 'value': 'GzQpWwlOsDX9vpZh-LzBZsHltsPQeDCt-yFYXIQFDFC-PzPIDBgvXAC8omU4-NgSt257wlaG1HUd4LwbWxSawS2HyxA1', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796371232, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'remarketing-web', 'value': 'A44FF1F4BAD363331C9E762A3353F48156E51FFB0FE37C499E7AF467CB1CFD5919FCD821DE3A1FF84E359A351CADFC45A1F8BF71FBB4E49F2C8E2DED1EB8F338451F0780FDEBDD641B1AD307CAA68020B14D5935FC08B322B494F0870788AA1DA890CC7A5C850ABA406C2FB7531728CE4F4AB096', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': -1, 'httpOnly': True, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918889887', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796371253, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': '7c5ddd5400730ffd0cd7ff6a45d6203298c4ba7185e109bbe8b19c56b08c2bcc82ee95b93add4db03d012a32f42cab9d409dface', 'domain': 'www.manheim.co.uk', 'path': '/', 'expires': 1796371253, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918889887', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796371254, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': '7c5ddd5400730ffd0cd7ff6a45d6203298c4ba7185e109bbe8b19c56b08c2bcc82ee95b93add4db03d012a32f42cab9d409dface', 'domain': 'brands.coxauto.co.uk', 'path': '/', 'expires': 1796371254, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592', 'value': '918889887', 'domain': '.pardot.com', 'path': '/', 'expires': 1796371253, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'visitor_id37592-hash', 'value': '7c5ddd5400730ffd0cd7ff6a45d6203298c4ba7185e109bbe8b19c56b08c2bcc82ee95b93add4db03d012a32f42cab9d409dface', 'domain': '.pardot.com', 'path': '/', 'expires': 1796371253, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/', 'expires': 1764837053, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2025-12-04 08:00:56 [manheim.gb] INFO: Scrapy-formatted cookies: [{'name': 'ASP.NET_SessionId', 'value': '5jea1fs2cb4hjdgzw0xaqxjt', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': '__RequestVerificationToken', 'value': 'GzQpWwlOsDX9vpZh-LzBZsHltsPQeDCt-yFYXIQFDFC-PzPIDBgvXAC8omU4-NgSt257wlaG1HUd4LwbWxSawS2HyxA1', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'cb-enabled', 'value': 'enabled', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'remarketing-web', 'value': 'A44FF1F4BAD363331C9E762A3353F48156E51FFB0FE37C499E7AF467CB1CFD5919FCD821DE3A1FF84E359A351CADFC45A1F8BF71FBB4E49F2C8E2DED1EB8F338451F0780FDEBDD641B1AD307CAA68020B14D5935FC08B322B494F0870788AA1DA890CC7A5C850ABA406C2FB7531728CE4F4AB096', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918889887', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': '7c5ddd5400730ffd0cd7ff6a45d6203298c4ba7185e109bbe8b19c56b08c2bcc82ee95b93add4db03d012a32f42cab9d409dface', 'domain': 'www.manheim.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918889887', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': '7c5ddd5400730ffd0cd7ff6a45d6203298c4ba7185e109bbe8b19c56b08c2bcc82ee95b93add4db03d012a32f42cab9d409dface', 'domain': 'brands.coxauto.co.uk', 'path': '/'}, {'name': 'visitor_id37592', 'value': '918889887', 'domain': '.pardot.com', 'path': '/'}, {'name': 'visitor_id37592-hash', 'value': '7c5ddd5400730ffd0cd7ff6a45d6203298c4ba7185e109bbe8b19c56b08c2bcc82ee95b93add4db03d012a32f42cab9d409dface', 'domain': '.pardot.com', 'path': '/'}, {'name': 'lpv37592', 'value': 'aHR0cHM6Ly93d3cubWFuaGVpbS5jby51ay9teW1hbmhlaW0vZGFzaGJvYXJk', 'domain': 'pi.pardot.com', 'path': '/'}]
2025-12-04 08:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Manheim',RowKey='cookies') HTTP/1.1" 204 0
2025-12-04 08:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-04 08:00:58 [manheim.gb] INFO: Found listing with ID: 1005857
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271005857%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1005857: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1019262
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271019262%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1019262: 2
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1078284
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271078284%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1078284: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1101758
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271101758%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1101758: 2
2025-12-04 08:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1104811
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271104811%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1104811: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1127441
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271127441%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1127441: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1153610
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271153610%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1153610: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1173100
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271173100%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1173100: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1191100
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271191100%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1191100: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1195824
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271195824%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1195824: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 124569
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27124569%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 124569: 2
2025-12-04 08:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1257174
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271257174%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1257174: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1271730
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271271730%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1271730: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1281726
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271281726%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1281726: 2
2025-12-04 08:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1297328
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271297328%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1297328: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1306828
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271306828%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1306828: 2
2025-12-04 08:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1314291
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271314291%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1314291: 2
2025-12-04 08:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1319653
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271319653%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1319653: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1376686
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271376686%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1376686: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1403363
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271403363%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1403363: 2
2025-12-04 08:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1405448
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271405448%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1405448: 2
2025-12-04 08:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1418917
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271418917%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1418917: 2
2025-12-04 08:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1432512
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271432512%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1432512: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1473959
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271473959%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1473959: 2
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1479833
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271479833%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1479833: 2
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1484153
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271484153%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1484153: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1490428
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271490428%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1490428: 2
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1501704
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271501704%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1501704: 2
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1535266
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271535266%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1535266: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1541191
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271541191%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1541191: 2
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1546758
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271546758%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1546758: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1563459
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271563459%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1563459: 2
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1580164
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271580164%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1580164: 2
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1701386
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271701386%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1701386: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1714274
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271714274%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1714274: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1753030
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271753030%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1753030: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1783769
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271783769%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1783769: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1787313
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271787313%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1787313: 2
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1798612
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271798612%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1798612: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1815539
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271815539%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1815539: 2
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1835329
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271835329%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1835329: 2
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1847472
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271847472%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1847472: 0
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1856076
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271856076%27 HTTP/1.1" 200 None
2025-12-04 08:00:59 [manheim.gb] INFO: Scrape type for 1856076: 2
2025-12-04 08:00:59 [manheim.gb] INFO: Found listing with ID: 1856565
2025-12-04 08:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271856565%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 1856565: 0
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 1859294
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271859294%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 1859294: 2
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 186738
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27186738%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 186738: 0
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 1877473
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271877473%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 1877473: 2
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 1912686
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271912686%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 1912686: 2
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 1950952
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271950952%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 1950952: 2
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 1962040
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271962040%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 1962040: 2
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 1976170
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271976170%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 1976170: 2
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 1984275
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271984275%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 1984275: 0
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 1995165
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271995165%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 1995165: 0
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 2014140
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272014140%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 2014140: 0
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 2022887
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272022887%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 2022887: 0
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 2057516
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272057516%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 2057516: 0
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 2058572
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272058572%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 2058572: 0
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 2063938
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272063938%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 2063938: 0
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 2091777
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272091777%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 2091777: 0
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 2093385
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272093385%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 2093385: 2
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 2143943
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272143943%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 2143943: 0
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 2176421
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272176421%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 2176421: 0
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 2186514
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272186514%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 2186514: 2
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 2213672
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272213672%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 2213672: 2
2025-12-04 08:01:00 [manheim.gb] INFO: Found listing with ID: 2237239
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272237239%27 HTTP/1.1" 200 None
2025-12-04 08:01:00 [manheim.gb] INFO: Scrape type for 2237239: 0
2025-12-04 08:01:20 [scrapy.extensions.logstats] INFO: Crawled 2 pages (at 2 pages/min), scraped 0 items (at 0 items/min)
2025-12-04 08:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1306828&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231306828&indx=23> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0996c4f7-2e70-59e7-9588-18c97575446d with identifier: 1306828
2025-12-04 08:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0996c4f7-2e70-59e7-9588-18c97575446d with scrape type 2
2025-12-04 08:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0996c4f7-2e70-59e7-9588-18c97575446d with scrape type 2
2025-12-04 08:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0996c4f7-2e70-59e7-9588-18c97575446d, identifier: 1306828
2025-12-04 08:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0996c4f7-2e70-59e7-9588-18c97575446d with identifier: 1306828
2025-12-04 08:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:01:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2025-12-04 08:01:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:01:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2025-12-04 08:01:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0996c4f7-2e70-59e7-9588-18c97575446d with identifier: 1306828
2025-12-04 08:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 182117 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182117
2025-12-04 08:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0996c4f7-2e70-59e7-9588-18c97575446d spider: manheim.gb
2025-12-04 08:01:24 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 0996c4f7-2e70-59e7-9588-18c97575446d due to rule: high_mileage_for_country.json, error: 182117 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182117
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001306828-01981454-004.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0996c4f7-2e70-59e7-9588-18c97575446d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SA60OBL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1306828',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 113163,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-07',
 'seller_name': 'Busseys',
 'title': 'FORD FOCUS 1.6 Titanium 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 Titanium 5dr Auto',
 'year': 2010}
2025-12-04 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271306828%27 HTTP/1.1" 200 None
2025-12-04 08:01:24 [manheim.gb] INFO: Saving data for 1306828: {'auction_closing_time': 1764838800.0, 'created_time': 1764583676.84982, 'last_price_update_time': 1764835284.329653}
2025-12-04 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1306828') HTTP/1.1" 204 0
2025-12-04 08:01:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A1?id=1101758&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231101758&indx=7> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 722002fe-0a5f-57a0-868d-fdc59423d036 with identifier: 1101758
2025-12-04 08:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 722002fe-0a5f-57a0-868d-fdc59423d036 with scrape type 2
2025-12-04 08:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 722002fe-0a5f-57a0-868d-fdc59423d036 with scrape type 2
2025-12-04 08:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 722002fe-0a5f-57a0-868d-fdc59423d036, identifier: 1101758
2025-12-04 08:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 722002fe-0a5f-57a0-868d-fdc59423d036 with identifier: 1101758
2025-12-04 08:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 722002fe-0a5f-57a0-868d-fdc59423d036 with identifier: 1101758
2025-12-04 08:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
2025-12-04 08:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 722002fe-0a5f-57a0-868d-fdc59423d036 spider: manheim.gb
2025-12-04 08:01:28 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 722002fe-0a5f-57a0-868d-fdc59423d036 due to rule: registration_date_old.json, error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001101758-01984290-002.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '722002fe-0a5f-57a0-868d-fdc59423d036',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KN62LZX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A1?id=1101758',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'AUDI',
 'model': 'A1',
 'odometer': 92297,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-09',
 'seller_name': 'Mon Motors',
 'title': 'AUDI A1 1.4 TFSI S Line 5dr',
 'transmission': 'manual',
 'trim': '1.4 TFSI S Line 5dr',
 'year': 2012}
2025-12-04 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271101758%27 HTTP/1.1" 200 None
2025-12-04 08:01:28 [manheim.gb] INFO: Saving data for 1101758: {'auction_closing_time': 1764838800.0, 'created_time': 1764741700.818832, 'last_price_update_time': 1764835288.469671}
2025-12-04 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1101758') HTTP/1.1" 204 0
2025-12-04 08:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY?id=1019262&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231019262&indx=2> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17dea801-4624-57df-bf1c-82420db11734 with identifier: 1019262
2025-12-04 08:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17dea801-4624-57df-bf1c-82420db11734 with scrape type 2
2025-12-04 08:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17dea801-4624-57df-bf1c-82420db11734 with scrape type 2
2025-12-04 08:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 17dea801-4624-57df-bf1c-82420db11734, identifier: 1019262
2025-12-04 08:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 17dea801-4624-57df-bf1c-82420db11734 with identifier: 1019262
2025-12-04 08:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:01:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2025-12-04 08:01:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:01:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2025-12-04 08:01:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 17dea801-4624-57df-bf1c-82420db11734 with identifier: 1019262
2025-12-04 08:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'land rover discovery 3.0 tdv6 xs 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'land rover', 'model': 'discovery', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'diesel', 'odometer': 135981, 'odometer_reading_unit': 'mi', 'registration_date': '2009-11-18', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/land%20rover/discovery?id=1019262', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '3.0 tdv6 xs 5dr auto', 'license_plate': 'gk59ybt', 'year': 2009, 'listing': 'auction', 'c_o_2_emission_value': 244, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001019262-01983742-004.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '17dea801-4624-57df-bf1c-82420db11734', 'current_year_diff': 16, 'age_in_months': 192, 'make_model': 'land rover discovery', 'sanitized_make': 'landrover', 'odometer_in_km': 218839}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 192,
     'auction_title': '',
     'c_o_2_emission_value': 244,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001019262-01983742-004.pdf',
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 16,
     'engine': '3.0l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': '17dea801-4624-57df-bf1c-82420db11734',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'gk59ybt',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/land%20rover/discovery?id=1019262',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'land rover',
     'make_model': 'land rover discovery',
     'model': 'discovery',
     'odometer': 135981,
     'odometer_in_km': 218839,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2009-11-18',
     'sanitized_make': 'landrover',
     'seller_name': None,
     'title': 'land rover discovery 3.0 tdv6 xs 5dr auto',
     'transmission': 'automatic',
     'trim': '3.0 tdv6 xs 5dr auto',
     'year': 2009}
2025-12-04 08:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 17dea801-4624-57df-bf1c-82420db11734 spider: manheim.gb
2025-12-04 08:01:30 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 17dea801-4624-57df-bf1c-82420db11734 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'land rover discovery 3.0 tdv6 xs 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'land rover', 'model': 'discovery', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'diesel', 'odometer': 135981, 'odometer_reading_unit': 'mi', 'registration_date': '2009-11-18', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/land%20rover/discovery?id=1019262', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '3.0 tdv6 xs 5dr auto', 'license_plate': 'gk59ybt', 'year': 2009, 'listing': 'auction', 'c_o_2_emission_value': 244, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001019262-01983742-004.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '17dea801-4624-57df-bf1c-82420db11734', 'current_year_diff': 16, 'age_in_months': 192, 'make_model': 'land rover discovery', 'sanitized_make': 'landrover', 'odometer_in_km': 218839}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 192,
     'auction_title': '',
     'c_o_2_emission_value': 244,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001019262-01983742-004.pdf',
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 16,
     'engine': '3.0l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': '17dea801-4624-57df-bf1c-82420db11734',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'gk59ybt',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/land%20rover/discovery?id=1019262',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'land rover',
     'make_model': 'land rover discovery',
     'model': 'discovery',
     'odometer': 135981,
     'odometer_in_km': 218839,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2009-11-18',
     'sanitized_make': 'landrover',
     'seller_name': None,
     'title': 'land rover discovery 3.0 tdv6 xs 5dr auto',
     'transmission': 'automatic',
     'trim': '3.0 tdv6 xs 5dr auto',
     'year': 2009}
{'auction_title': '',
 'c_o_2_emission_value': 244,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001019262-01983742-004.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '3.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '17dea801-4624-57df-bf1c-82420db11734',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GK59YBT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY?id=1019262',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY',
 'odometer': 135981,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-18',
 'seller_name': None,
 'title': 'LAND ROVER DISCOVERY 3.0 TDV6 XS 5dr Auto',
 'transmission': 'automatic',
 'trim': '3.0 TDV6 XS 5dr Auto',
 'year': 2009}
2025-12-04 08:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271019262%27 HTTP/1.1" 200 None
2025-12-04 08:01:30 [manheim.gb] INFO: Saving data for 1019262: {'auction_closing_time': 1764838800.0, 'created_time': 1764151334.413663, 'last_price_update_time': 1764835290.83612}
2025-12-04 08:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1019262') HTTP/1.1" 204 0
2025-12-04 08:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/HYUNDAI/I30?id=1281726&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231281726&indx=21> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 741ea8e0-089b-5709-bba9-fb16a7bce66c with identifier: 1281726
2025-12-04 08:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 741ea8e0-089b-5709-bba9-fb16a7bce66c with scrape type 2
2025-12-04 08:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 741ea8e0-089b-5709-bba9-fb16a7bce66c with scrape type 2
2025-12-04 08:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 741ea8e0-089b-5709-bba9-fb16a7bce66c, identifier: 1281726
2025-12-04 08:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 741ea8e0-089b-5709-bba9-fb16a7bce66c with identifier: 1281726
2025-12-04 08:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:01:31 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=White HTTP/1.1" 200 None
2025-12-04 08:01:31 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 741ea8e0-089b-5709-bba9-fb16a7bce66c with identifier: 1281726
2025-12-04 08:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-04 08:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 741ea8e0-089b-5709-bba9-fb16a7bce66c spider: manheim.gb
2025-12-04 08:01:32 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 741ea8e0-089b-5709-bba9-fb16a7bce66c due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 94,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001281726-01981349-003.pdf',
 'color': 'White',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '741ea8e0-089b-5709-bba9-fb16a7bce66c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FV65FRJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/HYUNDAI/I30?id=1281726',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'HYUNDAI',
 'model': 'I30',
 'odometer': 85229,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-16',
 'seller_name': None,
 'title': 'HYUNDAI I30 1.6 CRDi Blue Drive SE 5dr',
 'transmission': 'manual',
 'trim': '1.6 CRDi Blue Drive SE 5dr',
 'year': 2015}
2025-12-04 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271281726%27 HTTP/1.1" 200 None
2025-12-04 08:01:32 [manheim.gb] INFO: Saving data for 1281726: {'auction_closing_time': 1764838800.0, 'created_time': 1764583893.725442, 'last_price_update_time': 1764835292.059336}
2025-12-04 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1281726') HTTP/1.1" 204 0
2025-12-04 08:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/INSIGNIA?id=1314291&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231314291&indx=24> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9376b1c4-967f-5b84-83f8-6c73fe1d80a5 with identifier: 1314291
2025-12-04 08:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9376b1c4-967f-5b84-83f8-6c73fe1d80a5 with scrape type 2
2025-12-04 08:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9376b1c4-967f-5b84-83f8-6c73fe1d80a5 with scrape type 2
2025-12-04 08:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 9376b1c4-967f-5b84-83f8-6c73fe1d80a5, identifier: 1314291
2025-12-04 08:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 9376b1c4-967f-5b84-83f8-6c73fe1d80a5 with identifier: 1314291
2025-12-04 08:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:01:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2025-12-04 08:01:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 9376b1c4-967f-5b84-83f8-6c73fe1d80a5 with identifier: 1314291
2025-12-04 08:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'corner park garages', 'price_includes_vat': False, 'title': 'vauxhall insignia 2.0 cdti [140] ecoflex design nav 5dr [start stop]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'insignia', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 138705, 'odometer_reading_unit': 'mi', 'registration_date': '2014-03-05', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/insignia?id=1314291', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '2.0 cdti [140] ecoflex design nav 5dr [start stop]', 'license_plate': 'dy14bzu', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 98, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001314291-01976910-003.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '9376b1c4-967f-5b84-83f8-6c73fe1d80a5', 'current_year_diff': 11, 'age_in_months': 140, 'make_model': 'vauxhall insignia', 'sanitized_make': 'vauxhall', 'odometer_in_km': 223223}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 140,
     'auction_title': '',
     'c_o_2_emission_value': 98,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001314291-01976910-003.pdf',
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '2.0l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': '9376b1c4-967f-5b84-83f8-6c73fe1d80a5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'dy14bzu',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/insignia?id=1314291',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'vauxhall',
     'make_model': 'vauxhall insignia',
     'model': 'insignia',
     'odometer': 138705,
     'odometer_in_km': 223223,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-03-05',
     'sanitized_make': 'vauxhall',
     'seller_name': 'corner park garages',
     'title': 'vauxhall insignia 2.0 cdti [140] ecoflex design nav 5dr '
              '[start stop]',
     'transmission': 'manual',
     'trim': '2.0 cdti [140] ecoflex design nav 5dr [start stop]',
     'year': 2014}
2025-12-04 08:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 9376b1c4-967f-5b84-83f8-6c73fe1d80a5 spider: manheim.gb
2025-12-04 08:01:32 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 9376b1c4-967f-5b84-83f8-6c73fe1d80a5 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'corner park garages', 'price_includes_vat': False, 'title': 'vauxhall insignia 2.0 cdti [140] ecoflex design nav 5dr [start stop]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'insignia', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 138705, 'odometer_reading_unit': 'mi', 'registration_date': '2014-03-05', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/insignia?id=1314291', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '2.0 cdti [140] ecoflex design nav 5dr [start stop]', 'license_plate': 'dy14bzu', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 98, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001314291-01976910-003.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '9376b1c4-967f-5b84-83f8-6c73fe1d80a5', 'current_year_diff': 11, 'age_in_months': 140, 'make_model': 'vauxhall insignia', 'sanitized_make': 'vauxhall', 'odometer_in_km': 223223}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 140,
     'auction_title': '',
     'c_o_2_emission_value': 98,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001314291-01976910-003.pdf',
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '2.0l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': '9376b1c4-967f-5b84-83f8-6c73fe1d80a5',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'dy14bzu',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/insignia?id=1314291',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'vauxhall',
     'make_model': 'vauxhall insignia',
     'model': 'insignia',
     'odometer': 138705,
     'odometer_in_km': 223223,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-03-05',
     'sanitized_make': 'vauxhall',
     'seller_name': 'corner park garages',
     'title': 'vauxhall insignia 2.0 cdti [140] ecoflex design nav 5dr '
              '[start stop]',
     'transmission': 'manual',
     'trim': '2.0 cdti [140] ecoflex design nav 5dr [start stop]',
     'year': 2014}
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001314291-01976910-003.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9376b1c4-967f-5b84-83f8-6c73fe1d80a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DY14BZU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/INSIGNIA?id=1314291',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'VAUXHALL',
 'model': 'INSIGNIA',
 'odometer': 138705,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-05',
 'seller_name': 'Corner Park Garages',
 'title': 'VAUXHALL INSIGNIA 2.0 CDTi [140] ecoFLEX Design Nav 5dr [Start '
          'Stop]',
 'transmission': 'manual',
 'trim': '2.0 CDTi [140] ecoFLEX Design Nav 5dr [Start Stop]',
 'year': 2014}
2025-12-04 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271314291%27 HTTP/1.1" 200 None
2025-12-04 08:01:32 [manheim.gb] INFO: Saving data for 1314291: {'auction_closing_time': 1764838800.0, 'created_time': 1764583343.206979, 'last_price_update_time': 1764835292.839779}
2025-12-04 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1314291') HTTP/1.1" 204 0
2025-12-04 08:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FIAT/PUNTOEVO?id=124569&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23124569&indx=18> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0659ca46-f0c9-50ed-9faf-2cf9e173592e with identifier: 124569
2025-12-04 08:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0659ca46-f0c9-50ed-9faf-2cf9e173592e with scrape type 2
2025-12-04 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0659ca46-f0c9-50ed-9faf-2cf9e173592e with scrape type 2
2025-12-04 08:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0659ca46-f0c9-50ed-9faf-2cf9e173592e, identifier: 124569
2025-12-04 08:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0659ca46-f0c9-50ed-9faf-2cf9e173592e with identifier: 124569
2025-12-04 08:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0659ca46-f0c9-50ed-9faf-2cf9e173592e with identifier: 124569
2025-12-04 08:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 163893 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163893
2025-12-04 08:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0659ca46-f0c9-50ed-9faf-2cf9e173592e spider: manheim.gb
2025-12-04 08:01:33 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 0659ca46-f0c9-50ed-9faf-2cf9e173592e due to rule: high_mileage_for_country.json, error: 163893 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    163893
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000124569-01981427-003.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0659ca46-f0c9-50ed-9faf-2cf9e173592e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DY12HYB',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/PUNTO%20EVO?id=124569',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'FIAT',
 'model': 'PUNTO EVO',
 'odometer': 101839,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-06',
 'seller_name': 'Hendy Group',
 'title': 'FIAT PUNTO EVO 1.4 GP 5dr',
 'transmission': 'manual',
 'trim': '1.4 GP 5dr',
 'year': 2012}
2025-12-04 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27124569%27 HTTP/1.1" 200 None
2025-12-04 08:01:33 [manheim.gb] INFO: Saving data for 124569: {'auction_closing_time': 1764838800.0, 'created_time': 1764583319.286998, 'last_price_update_time': 1764835293.405264}
2025-12-04 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='124569') HTTP/1.1" 204 0
2025-12-04 08:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/GRANDC4PICASSO?id=1405448&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231405448&indx=30> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3a60c56-bd80-563c-9cc0-7ea8eee69993 with identifier: 1405448
2025-12-04 08:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3a60c56-bd80-563c-9cc0-7ea8eee69993 with scrape type 2
2025-12-04 08:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3a60c56-bd80-563c-9cc0-7ea8eee69993 with scrape type 2
2025-12-04 08:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e3a60c56-bd80-563c-9cc0-7ea8eee69993, identifier: 1405448
2025-12-04 08:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e3a60c56-bd80-563c-9cc0-7ea8eee69993 with identifier: 1405448
2025-12-04 08:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:01:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY HTTP/1.1" 200 None
2025-12-04 08:01:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e3a60c56-bd80-563c-9cc0-7ea8eee69993 with identifier: 1405448
2025-12-04 08:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e3a60c56-bd80-563c-9cc0-7ea8eee69993 with identifier: 1405448 to the API
2025-12-04 08:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/CITROEN/GRANDC4PICASSO?id=1405448&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231405448&indx=30>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001405448-01977041-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'e3a60c56-bd80-563c-9cc0-7ea8eee69993',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LF17ANR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/GRAND%20C4%20PICASSO?id=1405448',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'CITROEN',
 'model': 'GRAND C4 PICASSO',
 'odometer': 82038,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seller_name': 'Motor Dough',
 'title': 'CITROEN GRAND C4 PICASSO 1.6 BlueHDi Feel 5dr',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi Feel 5dr',
 'year': 2017}
2025-12-04 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271405448%27 HTTP/1.1" 200 None
2025-12-04 08:01:34 [manheim.gb] INFO: Saving data for 1405448: {'auction_closing_time': 1764838800.0, 'created_time': 1764584219.931124, 'last_price_update_time': 1764835294.371184}
2025-12-04 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1405448') HTTP/1.1" 204 0
2025-12-04 08:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=1403363&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231403363&indx=29> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b52da2da-653c-5b4d-a08e-32993ce7bdc2 with identifier: 1403363
2025-12-04 08:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b52da2da-653c-5b4d-a08e-32993ce7bdc2 with scrape type 2
2025-12-04 08:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b52da2da-653c-5b4d-a08e-32993ce7bdc2 with scrape type 2
2025-12-04 08:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b52da2da-653c-5b4d-a08e-32993ce7bdc2, identifier: 1403363
2025-12-04 08:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b52da2da-653c-5b4d-a08e-32993ce7bdc2 with identifier: 1403363
2025-12-04 08:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:01:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2025-12-04 08:01:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b52da2da-653c-5b4d-a08e-32993ce7bdc2 with identifier: 1403363
2025-12-04 08:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b52da2da-653c-5b4d-a08e-32993ce7bdc2 with identifier: 1403363 to the API
2025-12-04 08:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=1403363&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231403363&indx=29>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001403363-01982347-004.pdf',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b52da2da-653c-5b4d-a08e-32993ce7bdc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VK17WSF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=1403363',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 68242,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-31',
 'seller_name': 'Sandicliffe',
 'title': 'NISSAN JUKE 1.2 DiG-T Tekna Pulse 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T Tekna Pulse 5dr',
 'year': 2017}
2025-12-04 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271403363%27 HTTP/1.1" 200 None
2025-12-04 08:01:39 [manheim.gb] INFO: Saving data for 1403363: {'auction_closing_time': 1764925200.0, 'created_time': 1764583359.109947, 'last_price_update_time': 1764835299.642861}
2025-12-04 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1403363') HTTP/1.1" 204 0
2025-12-04 08:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1418917&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231418917&indx=33> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d313d20e-3e85-5824-9c26-e84f724785c6 with identifier: 1418917
2025-12-04 08:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d313d20e-3e85-5824-9c26-e84f724785c6 with scrape type 2
2025-12-04 08:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d313d20e-3e85-5824-9c26-e84f724785c6 with scrape type 2
2025-12-04 08:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d313d20e-3e85-5824-9c26-e84f724785c6, identifier: 1418917
2025-12-04 08:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d313d20e-3e85-5824-9c26-e84f724785c6 with identifier: 1418917
2025-12-04 08:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d313d20e-3e85-5824-9c26-e84f724785c6 with identifier: 1418917
2025-12-04 08:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157446 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157446
2025-12-04 08:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d313d20e-3e85-5824-9c26-e84f724785c6 spider: manheim.gb
2025-12-04 08:01:50 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: d313d20e-3e85-5824-9c26-e84f724785c6 due to rule: high_mileage_for_country.json, error: 157446 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157446
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001418917-01981846-004.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd313d20e-3e85-5824-9c26-e84f724785c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YR65OOF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1418917',
 'listing': 'auction',
 'location': 'Shotts',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 97833,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-30',
 'seller_name': None,
 'title': 'FORD FOCUS 1.5 TDCi 120 Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.5 TDCi 120 Titanium 5dr',
 'year': 2015}
2025-12-04 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271418917%27 HTTP/1.1" 200 None
2025-12-04 08:01:50 [manheim.gb] INFO: Saving data for 1418917: {'auction_closing_time': 1764838800.0, 'created_time': 1764584221.653834, 'last_price_update_time': 1764835310.542322}
2025-12-04 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1418917') HTTP/1.1" 204 0
2025-12-04 08:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIETTA?id=1473959&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231473959&indx=36> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1110047e-8b55-52b8-89d0-099ad071e0f4 with identifier: 1473959
2025-12-04 08:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1110047e-8b55-52b8-89d0-099ad071e0f4 with scrape type 2
2025-12-04 08:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1110047e-8b55-52b8-89d0-099ad071e0f4 with scrape type 2
2025-12-04 08:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1110047e-8b55-52b8-89d0-099ad071e0f4, identifier: 1473959
2025-12-04 08:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1110047e-8b55-52b8-89d0-099ad071e0f4 with identifier: 1473959
2025-12-04 08:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:01:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2025-12-04 08:01:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1110047e-8b55-52b8-89d0-099ad071e0f4 with identifier: 1473959
2025-12-04 08:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
2025-12-04 08:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 1110047e-8b55-52b8-89d0-099ad071e0f4 spider: manheim.gb
2025-12-04 08:01:52 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 1110047e-8b55-52b8-89d0-099ad071e0f4 due to rule: registration_date_old.json, error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001473959-01976716-004.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1110047e-8b55-52b8-89d0-099ad071e0f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FE13KKR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIETTA?id=1473959',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'ALFA ROMEO',
 'model': 'GIULIETTA',
 'odometer': 75006,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-28',
 'seller_name': 'Stellantis & You',
 'title': 'ALFA ROMEO GIULIETTA 1.4 TB MultiAir Lusso 5dr TCT',
 'transmission': 'automatic',
 'trim': '1.4 TB MultiAir Lusso 5dr TCT',
 'year': 2013}
2025-12-04 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271473959%27 HTTP/1.1" 200 None
2025-12-04 08:01:52 [manheim.gb] INFO: Saving data for 1473959: {'auction_closing_time': 1764838800.0, 'created_time': 1764584231.801743, 'last_price_update_time': 1764835312.982497}
2025-12-04 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1473959') HTTP/1.1" 204 0
2025-12-04 08:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-04 08:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2255783
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272255783%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2255783: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2262431
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272262431%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2262431: 2
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2286249
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272286249%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2286249: 2
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2292492
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272292492%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2292492: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2292927
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272292927%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2292927: 2
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2301535
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272301535%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2301535: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2303707
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272303707%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2303707: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2316345
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272316345%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2316345: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2326281
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272326281%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2326281: 2
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2354571
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272354571%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2354571: 2
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2359941
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272359941%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2359941: 2
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2365471
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272365471%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2365471: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2374569
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272374569%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2374569: 2
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2395632
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272395632%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2395632: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2407950
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272407950%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2407950: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2416699
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272416699%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2416699: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2437613
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272437613%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2437613: 2
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2443557
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272443557%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2443557: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2443996
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272443996%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2443996: 2
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2456004
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272456004%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2456004: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2458076
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272458076%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2458076: 2
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2461241
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272461241%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2461241: 2
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2492073
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272492073%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2492073: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2512673
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272512673%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2512673: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2528107
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272528107%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2528107: 2
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2528639
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272528639%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2528639: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2542025
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272542025%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2542025: 2
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 255681
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27255681%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 255681: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2557325
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272557325%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2557325: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2562472
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272562472%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2562472: 2
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2577653
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272577653%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2577653: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2589156
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272589156%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2589156: 2
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2590049
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272590049%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2590049: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2609231
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272609231%27 HTTP/1.1" 200 None
2025-12-04 08:01:53 [manheim.gb] INFO: Scrape type for 2609231: 0
2025-12-04 08:01:53 [manheim.gb] INFO: Found listing with ID: 2616439
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272616439%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2616439: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2628170
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272628170%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2628170: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2654910
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272654910%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2654910: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2664010
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272664010%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2664010: 2
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2667513
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272667513%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2667513: 2
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2688065
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272688065%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2688065: 2
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2699424
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272699424%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2699424: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 269980
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27269980%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 269980: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2727315
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272727315%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2727315: 2
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2733772
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272733772%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2733772: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2744515
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272744515%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2744515: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2746923
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272746923%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2746923: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2752960
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272752960%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2752960: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2765368
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272765368%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2765368: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2765752
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272765752%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2765752: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2778685
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272778685%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2778685: 2
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2782744
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272782744%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2782744: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2809184
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272809184%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2809184: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2817812
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272817812%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2817812: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2830703
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272830703%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2830703: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2886723
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272886723%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2886723: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2891297
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272891297%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2891297: 2
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2893691
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272893691%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2893691: 2
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2896151
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272896151%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2896151: 2
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2907623
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272907623%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2907623: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2933109
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272933109%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2933109: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2936605
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272936605%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2936605: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2936956
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272936956%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2936956: 2
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2939815
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272939815%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2939815: 2
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2944079
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272944079%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2944079: 2
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2948457
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272948457%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2948457: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2956148
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272956148%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2956148: 2
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2968035
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272968035%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2968035: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2968609
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272968609%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2968609: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2976938
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272976938%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2976938: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 2983373
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272983373%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 2983373: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 3000496
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273000496%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 3000496: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 3004217
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273004217%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 3004217: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 3017186
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273017186%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 3017186: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 3046148
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273046148%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 3046148: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 3049627
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273049627%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 3049627: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 3052566
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273052566%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 3052566: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 3054349
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273054349%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 3054349: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 3058021
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273058021%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 3058021: 0
2025-12-04 08:01:54 [manheim.gb] INFO: Found listing with ID: 3066375
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273066375%27 HTTP/1.1" 200 None
2025-12-04 08:01:54 [manheim.gb] INFO: Scrape type for 3066375: 0
2025-12-04 08:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1479833&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231479833&indx=37> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:01:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef122e00-3e3f-57a1-86ec-bee4854c2ed3 with identifier: 1479833
2025-12-04 08:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef122e00-3e3f-57a1-86ec-bee4854c2ed3 with scrape type 2
2025-12-04 08:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef122e00-3e3f-57a1-86ec-bee4854c2ed3 with scrape type 2
2025-12-04 08:01:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ef122e00-3e3f-57a1-86ec-bee4854c2ed3, identifier: 1479833
2025-12-04 08:01:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ef122e00-3e3f-57a1-86ec-bee4854c2ed3 with identifier: 1479833
2025-12-04 08:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ef122e00-3e3f-57a1-86ec-bee4854c2ed3 with identifier: 1479833
2025-12-04 08:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-04 08:01:56 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: ef122e00-3e3f-57a1-86ec-bee4854c2ed3 spider: manheim.gb
2025-12-04 08:01:56 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: ef122e00-3e3f-57a1-86ec-bee4854c2ed3 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001479833-01987353-003.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ef122e00-3e3f-57a1-86ec-bee4854c2ed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KX15LVN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1479833',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 58109,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-25',
 'seller_name': 'Sandicliffe',
 'title': 'NISSAN QASHQAI 1.2 DiG-T N-Tec 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T N-Tec 5dr',
 'year': 2015}
2025-12-04 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271479833%27 HTTP/1.1" 200 None
2025-12-04 08:01:56 [manheim.gb] INFO: Saving data for 1479833: {'auction_closing_time': 1764925200.0, 'created_time': 1764584239.187783, 'last_price_update_time': 1764835316.739163}
2025-12-04 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1479833') HTTP/1.1" 204 0
2025-12-04 08:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGEROVER?id=1490428&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231490428&indx=40> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:01:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33580bbc-f4fb-5453-afca-06c1a06e06fa with identifier: 1490428
2025-12-04 08:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33580bbc-f4fb-5453-afca-06c1a06e06fa with scrape type 2
2025-12-04 08:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33580bbc-f4fb-5453-afca-06c1a06e06fa with scrape type 2
2025-12-04 08:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 33580bbc-f4fb-5453-afca-06c1a06e06fa, identifier: 1490428
2025-12-04 08:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 33580bbc-f4fb-5453-afca-06c1a06e06fa with identifier: 1490428
2025-12-04 08:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:01:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2025-12-04 08:01:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 33580bbc-f4fb-5453-afca-06c1a06e06fa with identifier: 1490428
2025-12-04 08:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168095 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168095
2025-12-04 08:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 33580bbc-f4fb-5453-afca-06c1a06e06fa spider: manheim.gb
2025-12-04 08:01:59 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 33580bbc-f4fb-5453-afca-06c1a06e06fa due to rule: high_mileage_for_country.json, error: 168095 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168095
{'auction_title': '',
 'c_o_2_emission_value': 253,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001490428-01986223-003.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '4.4L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '33580bbc-f4fb-5453-afca-06c1a06e06fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NU12DLF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/RANGE%20ROVER?id=1490428',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER',
 'odometer': 104450,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-30',
 'seller_name': 'Pentagon Group',
 'title': 'LAND ROVER RANGE ROVER 4.4 TDV8 Autobiography 4dr Auto',
 'transmission': 'automatic',
 'trim': '4.4 TDV8 Autobiography 4dr Auto',
 'year': 2012}
2025-12-04 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271490428%27 HTTP/1.1" 200 None
2025-12-04 08:01:59 [manheim.gb] INFO: Saving data for 1490428: {'auction_closing_time': 1764838800.0, 'created_time': 1764741727.054156, 'last_price_update_time': 1764835319.978132}
2025-12-04 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1490428') HTTP/1.1" 204 0
2025-12-04 08:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/DS/DS4?id=1541191&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231541191&indx=46> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:02:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with identifier: 1541191
2025-12-04 08:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with scrape type 2
2025-12-04 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with scrape type 2
2025-12-04 08:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d, identifier: 1541191
2025-12-04 08:02:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with identifier: 1541191
2025-12-04 08:02:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with identifier: 1541191
2025-12-04 08:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d with identifier: 1541191 to the API
2025-12-04 08:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/DS/DS4?id=1541191&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231541191&indx=46>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001541191-01986958-004.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '7f9cc0f6-8f1c-550d-a3b4-e095cb0e8c4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NU16RKE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/DS/DS%204?id=1541191',
 'listing': 'auction',
 'location': 'Shotts',
 'make': 'DS',
 'model': 'DS 4',
 'odometer': 79280,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-16',
 'seller_name': 'Parks Motor Group',
 'title': 'DS DS 4 1.6 BlueHDi Prestige 5dr',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi Prestige 5dr',
 'year': 2016}
2025-12-04 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271541191%27 HTTP/1.1" 200 None
2025-12-04 08:02:04 [manheim.gb] INFO: Saving data for 1541191: {'auction_closing_time': 1764838800.0, 'created_time': 1764584185.261476, 'last_price_update_time': 1764835324.295957}
2025-12-04 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1541191') HTTP/1.1" 204 0
2025-12-04 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1563459&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231563459&indx=48> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b91ba86d-bc73-5696-96a9-f412028ff431 with identifier: 1563459
2025-12-04 08:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b91ba86d-bc73-5696-96a9-f412028ff431 with scrape type 2
2025-12-04 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b91ba86d-bc73-5696-96a9-f412028ff431 with scrape type 2
2025-12-04 08:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b91ba86d-bc73-5696-96a9-f412028ff431, identifier: 1563459
2025-12-04 08:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b91ba86d-bc73-5696-96a9-f412028ff431 with identifier: 1563459
2025-12-04 08:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:02:04 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2025-12-04 08:02:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b91ba86d-bc73-5696-96a9-f412028ff431 with identifier: 1563459
2025-12-04 08:02:04 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b91ba86d-bc73-5696-96a9-f412028ff431 with identifier: 1563459 to the API
2025-12-04 08:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:02:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:02:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1563459&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231563459&indx=48>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001563459-01985804-003.pdf',
 'color': 'Silver',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b91ba86d-bc73-5696-96a9-f412028ff431',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BW17UEY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=1563459',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 68158,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-12',
 'seller_name': 'Perrys',
 'title': 'FORD FOCUS 1.5 TDCi 120 Zetec Edition 5dr',
 'transmission': 'manual',
 'trim': '1.5 TDCi 120 Zetec Edition 5dr',
 'year': 2017}
2025-12-04 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271563459%27 HTTP/1.1" 200 None
2025-12-04 08:02:05 [manheim.gb] INFO: Saving data for 1563459: {'auction_closing_time': 1764925200.0, 'created_time': 1764584148.940929, 'last_price_update_time': 1764835325.009908}
2025-12-04 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1563459') HTTP/1.1" 204 0
2025-12-04 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=1580164&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231580164&indx=50> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:02:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc573ca1-c331-529e-9992-76c06b7bdec8 with identifier: 1580164
2025-12-04 08:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc573ca1-c331-529e-9992-76c06b7bdec8 with scrape type 2
2025-12-04 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc573ca1-c331-529e-9992-76c06b7bdec8 with scrape type 2
2025-12-04 08:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fc573ca1-c331-529e-9992-76c06b7bdec8, identifier: 1580164
2025-12-04 08:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fc573ca1-c331-529e-9992-76c06b7bdec8 with identifier: 1580164
2025-12-04 08:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fc573ca1-c331-529e-9992-76c06b7bdec8 with identifier: 1580164
2025-12-04 08:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166663 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166663
2025-12-04 08:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: fc573ca1-c331-529e-9992-76c06b7bdec8 spider: manheim.gb
2025-12-04 08:02:06 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: fc573ca1-c331-529e-9992-76c06b7bdec8 due to rule: high_mileage_for_country.json, error: 166663 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    166663
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001580164-01982640-003.pdf',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'fc573ca1-c331-529e-9992-76c06b7bdec8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PE12OBY',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=1580164',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 103560,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-17',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'VOLKSWAGEN GOLF 2.0 TDI BlueMotion Tech GT 2dr',
 'transmission': 'manual',
 'trim': '2.0 TDI BlueMotion Tech GT 2dr',
 'year': 2012}
2025-12-04 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271580164%27 HTTP/1.1" 200 None
2025-12-04 08:02:06 [manheim.gb] INFO: Saving data for 1580164: {'auction_closing_time': 1764838800.0, 'created_time': 1764584163.498681, 'last_price_update_time': 1764835326.969058}
2025-12-04 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1580164') HTTP/1.1" 204 0
2025-12-04 08:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/2SERIES?id=1501704&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231501704&indx=42> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:02:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4 with identifier: 1501704
2025-12-04 08:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4 with scrape type 2
2025-12-04 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4 with scrape type 2
2025-12-04 08:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4, identifier: 1501704
2025-12-04 08:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4 with identifier: 1501704
2025-12-04 08:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4 with identifier: 1501704
2025-12-04 08:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-04 08:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4 spider: manheim.gb
2025-12-04 08:02:14 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001501704-01955830-003.pdf',
 'color': 'Silver',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b648cc7e-d78f-531d-9ab6-03fcb9a5c6f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LF15UMM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/2%20SERIES?id=1501704',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'BMW',
 'model': '2 SERIES',
 'odometer': 44800,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-17',
 'seller_name': 'Lookers',
 'title': 'BMW 2 SERIES 220i Sport 2dr',
 'transmission': 'manual',
 'trim': '220i Sport 2dr',
 'year': 2015}
2025-12-04 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271501704%27 HTTP/1.1" 200 None
2025-12-04 08:02:14 [manheim.gb] INFO: Saving data for 1501704: {'auction_closing_time': 1764838800.0, 'created_time': 1764584157.927598, 'last_price_update_time': 1764835334.851914}
2025-12-04 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1501704') HTTP/1.1" 204 0
2025-12-04 08:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/AUDI/A5?id=2186514&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232186514&indx=93> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f with identifier: 2186514
2025-12-04 08:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f with scrape type 2
2025-12-04 08:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f with scrape type 2
2025-12-04 08:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f, identifier: 2186514
2025-12-04 08:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f with identifier: 2186514
2025-12-04 08:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f with identifier: 2186514
2025-12-04 08:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 158186 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158186
2025-12-04 08:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f spider: manheim.gb
2025-12-04 08:02:17 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 46fd0ce5-841d-52a8-a8d4-ce6b1226c23f due to rule: high_mileage_for_country.json, error: 158186 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    158186
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002186514-01984034-003.pdf',
 'color': 'Black',
 'currency': 'GBP',
 'engine': '1.8L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '46fd0ce5-841d-52a8-a8d4-ce6b1226c23f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LK13LBP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/AUDI/A5?id=2186514',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'AUDI',
 'model': 'A5',
 'odometer': 98293,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-20',
 'seller_name': 'Harwoods Group',
 'title': 'AUDI A5 1.8T FSI Black Edition 5dr Multitronic [5 Seat]',
 'transmission': 'automatic',
 'trim': '1.8T FSI Black Edition 5dr Multitronic [5 Seat]',
 'year': 2013}
2025-12-04 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272186514%27 HTTP/1.1" 200 None
2025-12-04 08:02:17 [manheim.gb] INFO: Saving data for 2186514: {'auction_closing_time': 1764838800.0, 'created_time': 1764583444.4361, 'last_price_update_time': 1764835337.348302}
2025-12-04 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2186514') HTTP/1.1" 204 0
2025-12-04 08:02:20 [scrapy.extensions.logstats] INFO: Crawled 20 pages (at 18 pages/min), scraped 4 items (at 4 items/min)
2025-12-04 08:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/RENAULT/MEGANE?id=2093385&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232093385&indx=88> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e with identifier: 2093385
2025-12-04 08:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e with scrape type 2
2025-12-04 08:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e with scrape type 2
2025-12-04 08:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e, identifier: 2093385
2025-12-04 08:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e with identifier: 2093385
2025-12-04 08:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e with identifier: 2093385
2025-12-04 08:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e with identifier: 2093385 to the API
2025-12-04 08:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/RENAULT/MEGANE?id=2093385&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232093385&indx=88>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002093385-01977123-002.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '89b8d5c2-e7bc-5d92-8c77-0de0f0c0978e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BG68UTX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/MEGANE?id=2093385',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'RENAULT',
 'model': 'MEGANE',
 'odometer': 53810,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-26',
 'seller_name': 'FCA Group',
 'title': 'RENAULT MEGANE 1.3 TCE GT Line 5dr',
 'transmission': 'manual',
 'trim': '1.3 TCE GT Line 5dr',
 'year': 2018}
2025-12-04 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272093385%27 HTTP/1.1" 200 None
2025-12-04 08:02:24 [manheim.gb] INFO: Saving data for 2093385: {'auction_closing_time': 1764838800.0, 'created_time': 1764583942.182081, 'last_price_update_time': 1764835344.032097}
2025-12-04 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2093385') HTTP/1.1" 204 0
2025-12-04 08:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/INSIGNIA?id=2213672&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232213672&indx=95> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:02:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ba4398d-22ae-5110-9b32-0ce2c03feac0 with identifier: 2213672
2025-12-04 08:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0 with scrape type 2
2025-12-04 08:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ba4398d-22ae-5110-9b32-0ce2c03feac0 with scrape type 2
2025-12-04 08:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 2ba4398d-22ae-5110-9b32-0ce2c03feac0, identifier: 2213672
2025-12-04 08:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 2ba4398d-22ae-5110-9b32-0ce2c03feac0 with identifier: 2213672
2025-12-04 08:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:02:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREEN HTTP/1.1" 200 None
2025-12-04 08:02:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 2ba4398d-22ae-5110-9b32-0ce2c03feac0 with identifier: 2213672
2025-12-04 08:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 187055 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    187055
2025-12-04 08:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2ba4398d-22ae-5110-9b32-0ce2c03feac0 spider: manheim.gb
2025-12-04 08:02:24 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 2ba4398d-22ae-5110-9b32-0ce2c03feac0 due to rule: high_mileage_for_country.json, error: 187055 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    187055
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002213672-01989421-002.pdf',
 'color': 'GREEN',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '2ba4398d-22ae-5110-9b32-0ce2c03feac0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FN16CVR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/INSIGNIA?id=2213672',
 'listing': 'directbuy',
 'location': 'Washington',
 'make': 'VAUXHALL',
 'model': 'INSIGNIA',
 'odometer': 116231,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': 'Lookers',
 'title': 'VAUXHALL INSIGNIA 1.6 CDTi SRi Vx-line Nav 5dr [Start Stop]',
 'transmission': 'manual',
 'trim': '1.6 CDTi SRi Vx-line Nav 5dr [Start Stop]',
 'year': 2016}
2025-12-04 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272213672%27 HTTP/1.1" 200 None
2025-12-04 08:02:24 [manheim.gb] INFO: Saving data for 2213672: {'auction_closing_time': 1764925200.0, 'created_time': 1764741761.881281, 'last_price_update_time': 1764835344.71481}
2025-12-04 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2213672') HTTP/1.1" 204 0
2025-12-04 08:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/SCLASS?id=1976170&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231976170&indx=77> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:02:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8ec3d9f-037e-5080-8a18-a670d1eb7b38 with identifier: 1976170
2025-12-04 08:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38 with scrape type 2
2025-12-04 08:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8ec3d9f-037e-5080-8a18-a670d1eb7b38 with scrape type 2
2025-12-04 08:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b8ec3d9f-037e-5080-8a18-a670d1eb7b38, identifier: 1976170
2025-12-04 08:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b8ec3d9f-037e-5080-8a18-a670d1eb7b38 with identifier: 1976170
2025-12-04 08:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b8ec3d9f-037e-5080-8a18-a670d1eb7b38 with identifier: 1976170
2025-12-04 08:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b8ec3d9f-037e-5080-8a18-a670d1eb7b38 with identifier: 1976170 to the API
2025-12-04 08:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/SCLASS?id=1976170&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231976170&indx=77>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001976170-01815378-004.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.9L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b8ec3d9f-037e-5080-8a18-a670d1eb7b38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ML18RKX',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/S%20CLASS?id=1976170',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'MERCEDES-BENZ',
 'model': 'S CLASS',
 'odometer': 40257,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-31',
 'seller_name': 'FCA Group',
 'title': 'MERCEDES-BENZ S CLASS S350d L AMG Line 4dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'S350d L AMG Line 4dr 9G-Tronic',
 'year': 2018}
2025-12-04 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271976170%27 HTTP/1.1" 200 None
2025-12-04 08:02:25 [manheim.gb] INFO: Saving data for 1976170: {'auction_closing_time': 1764925200.0, 'created_time': 1764741987.269152, 'last_price_update_time': 1764835345.612839}
2025-12-04 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1976170') HTTP/1.1" 204 0
2025-12-04 08:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search) ['zyte-api']
2025-12-04 08:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:02:26 [manheim.gb] INFO: Found listing with ID: 3093098
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273093098%27 HTTP/1.1" 200 None
2025-12-04 08:02:26 [manheim.gb] INFO: Scrape type for 3093098: 0
2025-12-04 08:02:26 [manheim.gb] INFO: Found listing with ID: 3093456
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273093456%27 HTTP/1.1" 200 None
2025-12-04 08:02:26 [manheim.gb] INFO: Scrape type for 3093456: 0
2025-12-04 08:02:26 [manheim.gb] INFO: Found listing with ID: 3107402
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273107402%27 HTTP/1.1" 200 None
2025-12-04 08:02:26 [manheim.gb] INFO: Scrape type for 3107402: 0
2025-12-04 08:02:26 [manheim.gb] INFO: Found listing with ID: 3112958
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273112958%27 HTTP/1.1" 200 None
2025-12-04 08:02:26 [manheim.gb] INFO: Scrape type for 3112958: 0
2025-12-04 08:02:26 [manheim.gb] INFO: Found listing with ID: 3120849
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273120849%27 HTTP/1.1" 200 None
2025-12-04 08:02:26 [manheim.gb] INFO: Scrape type for 3120849: 0
2025-12-04 08:02:26 [manheim.gb] INFO: Found listing with ID: 3132401
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273132401%27 HTTP/1.1" 200 None
2025-12-04 08:02:26 [manheim.gb] INFO: Scrape type for 3132401: 0
2025-12-04 08:02:26 [manheim.gb] INFO: Found listing with ID: 3148192
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273148192%27 HTTP/1.1" 200 None
2025-12-04 08:02:26 [manheim.gb] INFO: Scrape type for 3148192: 0
2025-12-04 08:02:26 [manheim.gb] INFO: Found listing with ID: 3154376
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273154376%27 HTTP/1.1" 200 None
2025-12-04 08:02:26 [manheim.gb] INFO: Scrape type for 3154376: 0
2025-12-04 08:02:26 [manheim.gb] INFO: Found listing with ID: 3161787
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273161787%27 HTTP/1.1" 200 None
2025-12-04 08:02:26 [manheim.gb] INFO: Scrape type for 3161787: 0
2025-12-04 08:02:26 [manheim.gb] INFO: Found listing with ID: 3163606
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273163606%27 HTTP/1.1" 200 None
2025-12-04 08:02:26 [manheim.gb] INFO: Scrape type for 3163606: 0
2025-12-04 08:02:26 [manheim.gb] INFO: Found listing with ID: 3167377
2025-12-04 08:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273167377%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3167377: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3171741
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273171741%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3171741: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3174678
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273174678%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3174678: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3193354
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273193354%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3193354: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3194283
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273194283%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3194283: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3204178
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273204178%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3204178: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3209297
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273209297%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3209297: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3210152
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273210152%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3210152: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3213348
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273213348%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3213348: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3227836
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273227836%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3227836: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3234444
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273234444%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3234444: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3235123
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273235123%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3235123: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3235969
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273235969%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3235969: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3243502
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273243502%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3243502: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3267329
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273267329%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3267329: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3267872
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273267872%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3267872: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3272956
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273272956%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3272956: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3276436
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273276436%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3276436: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3278878
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273278878%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3278878: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3288325
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273288325%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3288325: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3290272
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273290272%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3290272: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3292131
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273292131%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3292131: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3296314
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273296314%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3296314: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3300121
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273300121%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3300121: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3303034
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273303034%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3303034: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3303846
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273303846%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3303846: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3305808
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273305808%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3305808: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3305810
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273305810%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3305810: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3318690
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273318690%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3318690: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3331358
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273331358%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3331358: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3333029
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273333029%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3333029: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3338104
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273338104%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3338104: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3338885
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273338885%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3338885: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3342805
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273342805%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3342805: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3348750
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273348750%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3348750: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3350164
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273350164%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3350164: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3352809
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273352809%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3352809: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3356576
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273356576%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3356576: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3358545
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273358545%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3358545: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3366127
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273366127%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3366127: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3368334
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273368334%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3368334: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3376327
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273376327%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3376327: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3387097
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273387097%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3387097: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3409801
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273409801%27 HTTP/1.1" 200 None
2025-12-04 08:02:27 [manheim.gb] INFO: Scrape type for 3409801: 0
2025-12-04 08:02:27 [manheim.gb] INFO: Found listing with ID: 3417454
2025-12-04 08:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273417454%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 3417454: 0
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 3432289
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273432289%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 3432289: 0
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 3432714
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273432714%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 3432714: 0
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 343802
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27343802%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 343802: 0
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 3445714
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273445714%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 3445714: 0
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 3485191
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273485191%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 3485191: 0
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 3486378
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273486378%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 3486378: 0
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 3507560
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273507560%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 3507560: 0
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 3512799
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273512799%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 3512799: 0
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 3516831
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273516831%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 3516831: 0
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 3518224
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273518224%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 3518224: 1
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 352448
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27352448%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 352448: 1
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 3528421
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273528421%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 3528421: 1
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 3542461
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273542461%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 3542461: 1
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 3544627
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273544627%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 3544627: 1
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 3553764
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273553764%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 3553764: 1
2025-12-04 08:02:28 [manheim.gb] INFO: Found listing with ID: 3566423
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273566423%27 HTTP/1.1" 200 None
2025-12-04 08:02:28 [manheim.gb] INFO: Scrape type for 3566423: 1
2025-12-04 08:02:28 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 08:02:28 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 08:02:28 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 08:02:28 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 08:02:29 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 08:02:29 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 08:02:29 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field odometer is not nullable
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 08:02:29 [scrapy.core.scraper] ERROR: Spider error processing <POST https://www.manheim.co.uk/search/refine> (referer: https://www.manheim.co.uk/search)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
    yield await it.__anext__()
          ^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
    return await self.data.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
    async for o in as_async_generator(it):
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
    async for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
    async for item_or_request in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
    async for r in result or ():
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
    async for r in iterable:
  File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
    async for item in result:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
    for r in it:
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
    exception_result = self._process_spider_exception(
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
    result = method(response=response, exception=exception, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
    raise exception
  File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
    for r in iterable:
  File "/usr/src/app/crawlers/spiders/manheim.py", line 201, in parse_listings
    scraped_item = self._extract_listing_item(item, expiration_date)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/app/crawlers/spiders/manheim.py", line 281, in _extract_listing_item
    item["odometer"] = odometer
    ~~~~^^^^^^^^^^^^
  File "/usr/src/app/crawlers/items.py", line 115, in __setitem__
    raise ValueError(f"Field {key} is not nullable")
ValueError: Field odometer is not nullable
2025-12-04 08:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ACLASS?id=1962040&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231962040&indx=75> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:02:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe16ff0c-02dc-5b78-b499-78e1d2e32fac with identifier: 1962040
2025-12-04 08:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe16ff0c-02dc-5b78-b499-78e1d2e32fac with scrape type 2
2025-12-04 08:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe16ff0c-02dc-5b78-b499-78e1d2e32fac with scrape type 2
2025-12-04 08:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: fe16ff0c-02dc-5b78-b499-78e1d2e32fac, identifier: 1962040
2025-12-04 08:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: fe16ff0c-02dc-5b78-b499-78e1d2e32fac with identifier: 1962040
2025-12-04 08:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: fe16ff0c-02dc-5b78-b499-78e1d2e32fac with identifier: 1962040
2025-12-04 08:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: fe16ff0c-02dc-5b78-b499-78e1d2e32fac with identifier: 1962040 to the API
2025-12-04 08:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27fe16ff0c-02dc-5b78-b499-78e1d2e32fac%27 HTTP/1.1" 200 None
2025-12-04 08:02:31 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id fe16ff0c-02dc-5b78-b499-78e1d2e32fac: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 08:02:31 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 08:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/ACLASS?id=1962040&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231962040&indx=75>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001962040-01961556-003.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'fe16ff0c-02dc-5b78-b499-78e1d2e32fac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WR67XGA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/A%20CLASS?id=1962040',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS',
 'odometer': 47734,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-31',
 'seller_name': 'Wheelers Group',
 'title': 'MERCEDES-BENZ A CLASS A180d AMG Line 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A180d AMG Line 5dr Auto',
 'year': 2017}
2025-12-04 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271962040%27 HTTP/1.1" 200 None
2025-12-04 08:02:31 [manheim.gb] INFO: Saving data for 1962040: {'auction_closing_time': 1765184400.0, 'created_time': 1764583987.046153, 'last_price_update_time': 1764835351.959677}
2025-12-04 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1962040') HTTP/1.1" 204 0
2025-12-04 08:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/SKODA/OCTAVIA?id=1950952&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231950952&indx=74> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46e4e2fa-35d1-51aa-aa3e-d458911a9872 with identifier: 1950952
2025-12-04 08:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46e4e2fa-35d1-51aa-aa3e-d458911a9872 with scrape type 2
2025-12-04 08:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46e4e2fa-35d1-51aa-aa3e-d458911a9872 with scrape type 2
2025-12-04 08:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 46e4e2fa-35d1-51aa-aa3e-d458911a9872, identifier: 1950952
2025-12-04 08:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 46e4e2fa-35d1-51aa-aa3e-d458911a9872 with identifier: 1950952
2025-12-04 08:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 46e4e2fa-35d1-51aa-aa3e-d458911a9872 with identifier: 1950952
2025-12-04 08:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 0, 'seller_name': 'stellantis & you', 'price_includes_vat': False, 'title': 'skoda octavia 2.0 tdi cr vrs 5dr dsg', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'octavia', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 141308, 'odometer_reading_unit': 'mi', 'registration_date': '2014-10-23', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/octavia?id=1950952', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '2.0 tdi cr vrs 5dr dsg', 'license_plate': 'yc64xbz', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 129, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001950952-01983946-004.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '46e4e2fa-35d1-51aa-aa3e-d458911a9872', 'current_year_diff': 11, 'age_in_months': 133, 'make_model': 'skoda octavia', 'sanitized_make': 'skoda', 'odometer_in_km': 227412}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 133,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001950952-01983946-004.pdf',
     'color': 'green',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '2.0l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': '46e4e2fa-35d1-51aa-aa3e-d458911a9872',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'yc64xbz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/octavia?id=1950952',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'skoda',
     'make_model': 'skoda octavia',
     'model': 'octavia',
     'odometer': 141308,
     'odometer_in_km': 227412,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-10-23',
     'sanitized_make': 'skoda',
     'seller_name': 'stellantis & you',
     'title': 'skoda octavia 2.0 tdi cr vrs 5dr dsg',
     'transmission': 'automatic',
     'trim': '2.0 tdi cr vrs 5dr dsg',
     'year': 2014}
2025-12-04 08:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 46e4e2fa-35d1-51aa-aa3e-d458911a9872 spider: manheim.gb
2025-12-04 08:02:33 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 46e4e2fa-35d1-51aa-aa3e-d458911a9872 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 0, 'seller_name': 'stellantis & you', 'price_includes_vat': False, 'title': 'skoda octavia 2.0 tdi cr vrs 5dr dsg', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'octavia', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 141308, 'odometer_reading_unit': 'mi', 'registration_date': '2014-10-23', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/octavia?id=1950952', 'location': 'colchester', 'origin_country_code': 'gb', 'trim': '2.0 tdi cr vrs 5dr dsg', 'license_plate': 'yc64xbz', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 129, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001950952-01983946-004.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '46e4e2fa-35d1-51aa-aa3e-d458911a9872', 'current_year_diff': 11, 'age_in_months': 133, 'make_model': 'skoda octavia', 'sanitized_make': 'skoda', 'odometer_in_km': 227412}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 133,
     'auction_title': '',
     'c_o_2_emission_value': 129,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001950952-01983946-004.pdf',
     'color': 'green',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '2.0l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': '46e4e2fa-35d1-51aa-aa3e-d458911a9872',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'yc64xbz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/octavia?id=1950952',
     'listing': 'auction',
     'location': 'colchester',
     'make': 'skoda',
     'make_model': 'skoda octavia',
     'model': 'octavia',
     'odometer': 141308,
     'odometer_in_km': 227412,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-10-23',
     'sanitized_make': 'skoda',
     'seller_name': 'stellantis & you',
     'title': 'skoda octavia 2.0 tdi cr vrs 5dr dsg',
     'transmission': 'automatic',
     'trim': '2.0 tdi cr vrs 5dr dsg',
     'year': 2014}
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001950952-01983946-004.pdf',
 'color': 'GREEN',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '46e4e2fa-35d1-51aa-aa3e-d458911a9872',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YC64XBZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SKODA/OCTAVIA?id=1950952',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'SKODA',
 'model': 'OCTAVIA',
 'odometer': 141308,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-23',
 'seller_name': 'Stellantis & You',
 'title': 'SKODA OCTAVIA 2.0 TDI CR vRS 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI CR vRS 5dr DSG',
 'year': 2014}
2025-12-04 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271950952%27 HTTP/1.1" 200 None
2025-12-04 08:02:33 [manheim.gb] INFO: Saving data for 1950952: {'auction_closing_time': 1764838800.0, 'created_time': 1764584052.8576, 'last_price_update_time': 1764835353.239315}
2025-12-04 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1950952') HTTP/1.1" 204 0
2025-12-04 08:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=1912686&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231912686&indx=73> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1b26391-08cb-5b60-9737-ef0afa324128 with identifier: 1912686
2025-12-04 08:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1b26391-08cb-5b60-9737-ef0afa324128 with scrape type 2
2025-12-04 08:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1b26391-08cb-5b60-9737-ef0afa324128 with scrape type 2
2025-12-04 08:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f1b26391-08cb-5b60-9737-ef0afa324128, identifier: 1912686
2025-12-04 08:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f1b26391-08cb-5b60-9737-ef0afa324128 with identifier: 1912686
2025-12-04 08:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f1b26391-08cb-5b60-9737-ef0afa324128 with identifier: 1912686
2025-12-04 08:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
2025-12-04 08:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: f1b26391-08cb-5b60-9737-ef0afa324128 spider: manheim.gb
2025-12-04 08:02:34 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: f1b26391-08cb-5b60-9737-ef0afa324128 due to rule: registration_date_old.json, error: 12 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    12
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001912686-01985791-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f1b26391-08cb-5b60-9737-ef0afa324128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EK13XWL',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/CORSA?id=1912686',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'VAUXHALL',
 'model': 'CORSA',
 'odometer': 91770,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-27',
 'seller_name': 'Vindis Group',
 'title': 'VAUXHALL CORSA 1.4T Black Edition 3dr',
 'transmission': 'manual',
 'trim': '1.4T Black Edition 3dr',
 'year': 2013}
2025-12-04 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271912686%27 HTTP/1.1" 200 None
2025-12-04 08:02:34 [manheim.gb] INFO: Saving data for 1912686: {'auction_closing_time': 1764838800.0, 'created_time': 1764741983.44155, 'last_price_update_time': 1764835354.788978}
2025-12-04 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1912686') HTTP/1.1" 204 0
2025-12-04 08:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=1877473&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231877473&indx=72> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:02:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b69d29-057e-5615-9947-92f19df1ec23 with identifier: 1877473
2025-12-04 08:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b69d29-057e-5615-9947-92f19df1ec23 with scrape type 2
2025-12-04 08:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94b69d29-057e-5615-9947-92f19df1ec23 with scrape type 2
2025-12-04 08:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 94b69d29-057e-5615-9947-92f19df1ec23, identifier: 1877473
2025-12-04 08:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 94b69d29-057e-5615-9947-92f19df1ec23 with identifier: 1877473
2025-12-04 08:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:02:39 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BRONZE HTTP/1.1" 200 None
2025-12-04 08:02:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 94b69d29-057e-5615-9947-92f19df1ec23 with identifier: 1877473
2025-12-04 08:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 142882 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    142882
2025-12-04 08:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 94b69d29-057e-5615-9947-92f19df1ec23 spider: manheim.gb
2025-12-04 08:02:40 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 94b69d29-057e-5615-9947-92f19df1ec23 due to rule: high_mileage_for_make.json, error: 142882 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    142882
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001877473-01989665-002.pdf',
 'color': 'BRONZE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '94b69d29-057e-5615-9947-92f19df1ec23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KV18FSN',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/3008?id=1877473',
 'listing': 'auction',
 'location': 'Plymouth',
 'make': 'PEUGEOT',
 'model': '3008',
 'odometer': 88783,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': 'Vospers Group',
 'title': 'PEUGEOT 3008 1.6 BlueHDi 120 Allure 5dr',
 'transmission': 'manual',
 'trim': '1.6 BlueHDi 120 Allure 5dr',
 'year': 2018}
2025-12-04 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271877473%27 HTTP/1.1" 200 None
2025-12-04 08:02:40 [manheim.gb] INFO: Saving data for 1877473: {'auction_closing_time': 1765357200.0, 'created_time': 1764741984.979696, 'last_price_update_time': 1764835360.224292}
2025-12-04 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1877473') HTTP/1.1" 204 0
2025-12-04 08:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1859294&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231859294&indx=69> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:02:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778 with identifier: 1859294
2025-12-04 08:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778 with scrape type 2
2025-12-04 08:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778 with scrape type 2
2025-12-04 08:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778, identifier: 1859294
2025-12-04 08:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778 with identifier: 1859294
2025-12-04 08:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778 with identifier: 1859294
2025-12-04 08:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'nissan qashqai 1.6 dci n-tec+ 5dr xtronic', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'qashqai', 'transmission': 'automatic', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 130214, 'odometer_reading_unit': 'mi', 'registration_date': '2015-09-15', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/qashqai?id=1859294', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '1.6 dci n-tec+ 5dr xtronic', 'license_plate': 'lt65utp', 'year': 2015, 'listing': 'auction', 'c_o_2_emission_value': 128, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001859294-01977159-003.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778', 'current_year_diff': 10, 'age_in_months': 122, 'make_model': 'nissan qashqai', 'sanitized_make': 'nissan', 'odometer_in_km': 209558}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 122,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001859294-01977159-003.pdf',
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 10,
     'engine': '1.6l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'lt65utp',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/qashqai?id=1859294',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'nissan',
     'make_model': 'nissan qashqai',
     'model': 'qashqai',
     'odometer': 130214,
     'odometer_in_km': 209558,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2015-09-15',
     'sanitized_make': 'nissan',
     'seller_name': None,
     'title': 'nissan qashqai 1.6 dci n-tec+ 5dr xtronic',
     'transmission': 'automatic',
     'trim': '1.6 dci n-tec+ 5dr xtronic',
     'year': 2015}
2025-12-04 08:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778 spider: manheim.gb
2025-12-04 08:02:43 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'nissan qashqai 1.6 dci n-tec+ 5dr xtronic', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'qashqai', 'transmission': 'automatic', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 130214, 'odometer_reading_unit': 'mi', 'registration_date': '2015-09-15', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/qashqai?id=1859294', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '1.6 dci n-tec+ 5dr xtronic', 'license_plate': 'lt65utp', 'year': 2015, 'listing': 'auction', 'c_o_2_emission_value': 128, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001859294-01977159-003.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778', 'current_year_diff': 10, 'age_in_months': 122, 'make_model': 'nissan qashqai', 'sanitized_make': 'nissan', 'odometer_in_km': 209558}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 122,
     'auction_title': '',
     'c_o_2_emission_value': 128,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0001859294-01977159-003.pdf',
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 10,
     'engine': '1.6l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'lt65utp',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/qashqai?id=1859294',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'nissan',
     'make_model': 'nissan qashqai',
     'model': 'qashqai',
     'odometer': 130214,
     'odometer_in_km': 209558,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2015-09-15',
     'sanitized_make': 'nissan',
     'seller_name': None,
     'title': 'nissan qashqai 1.6 dci n-tec+ 5dr xtronic',
     'transmission': 'automatic',
     'trim': '1.6 dci n-tec+ 5dr xtronic',
     'year': 2015}
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001859294-01977159-003.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'a15b50bd-fd0c-5231-9cb4-a7e5f2ca9778',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LT65UTP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1859294',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 130214,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-15',
 'seller_name': None,
 'title': 'NISSAN QASHQAI 1.6 dCi N-Tec+ 5dr Xtronic',
 'transmission': 'automatic',
 'trim': '1.6 dCi N-Tec+ 5dr Xtronic',
 'year': 2015}
2025-12-04 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271859294%27 HTTP/1.1" 200 None
2025-12-04 08:02:43 [manheim.gb] INFO: Saving data for 1859294: {'auction_closing_time': 1764838800.0, 'created_time': 1764584045.598769, 'last_price_update_time': 1764835363.777214}
2025-12-04 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1859294') HTTP/1.1" 204 0
2025-12-04 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/JEEP/RENEGADE?id=2956148&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232956148&indx=185> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 430345f6-8c86-566e-b39a-48716bb0a1dd with identifier: 2956148
2025-12-04 08:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 430345f6-8c86-566e-b39a-48716bb0a1dd with scrape type 2
2025-12-04 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 430345f6-8c86-566e-b39a-48716bb0a1dd with scrape type 2
2025-12-04 08:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 430345f6-8c86-566e-b39a-48716bb0a1dd, identifier: 2956148
2025-12-04 08:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 430345f6-8c86-566e-b39a-48716bb0a1dd with identifier: 2956148
2025-12-04 08:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 430345f6-8c86-566e-b39a-48716bb0a1dd with identifier: 2956148
2025-12-04 08:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 430345f6-8c86-566e-b39a-48716bb0a1dd with identifier: 2956148 to the API
2025-12-04 08:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/JEEP/RENEGADE?id=2956148&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232956148&indx=185>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002956148-01976940-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '430345f6-8c86-566e-b39a-48716bb0a1dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DX17SOE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/JEEP/RENEGADE?id=2956148',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'JEEP',
 'model': 'RENEGADE',
 'odometer': 88127,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'JEEP RENEGADE 1.6 Multijet Sport 5dr',
 'transmission': 'manual',
 'trim': '1.6 Multijet Sport 5dr',
 'year': 2017}
2025-12-04 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272956148%27 HTTP/1.1" 200 None
2025-12-04 08:02:56 [manheim.gb] INFO: Saving data for 2956148: {'auction_closing_time': 1764838800.0, 'created_time': 1764748890.073087, 'last_price_update_time': 1764835376.52608}
2025-12-04 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2956148') HTTP/1.1" 204 0
2025-12-04 08:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/TIGUAN?id=1856076&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231856076&indx=67> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17393bf4-8b87-575f-90cc-271c21397470 with identifier: 1856076
2025-12-04 08:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17393bf4-8b87-575f-90cc-271c21397470 with scrape type 2
2025-12-04 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17393bf4-8b87-575f-90cc-271c21397470 with scrape type 2
2025-12-04 08:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 17393bf4-8b87-575f-90cc-271c21397470, identifier: 1856076
2025-12-04 08:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 17393bf4-8b87-575f-90cc-271c21397470 with identifier: 1856076
2025-12-04 08:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 17393bf4-8b87-575f-90cc-271c21397470 with identifier: 1856076
2025-12-04 08:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 185181 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185181
2025-12-04 08:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 17393bf4-8b87-575f-90cc-271c21397470 spider: manheim.gb
2025-12-04 08:03:02 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 17393bf4-8b87-575f-90cc-271c21397470 due to rule: high_mileage_for_country.json, error: 185181 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    185181
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001856076-01977163-004.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '17393bf4-8b87-575f-90cc-271c21397470',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SF15LTJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/TIGUAN?id=1856076',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN',
 'odometer': 115067,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-15',
 'seller_name': 'Baylis',
 'title': 'VOLKSWAGEN TIGUAN 2.0 TDi BlueMotion Tech Match 177 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDi BlueMotion Tech Match 177 5dr DSG',
 'year': 2015}
2025-12-04 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271856076%27 HTTP/1.1" 200 None
2025-12-04 08:03:02 [manheim.gb] INFO: Saving data for 1856076: {'auction_closing_time': 1764838800.0, 'created_time': 1764584029.498309, 'last_price_update_time': 1764835382.425029}
2025-12-04 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1856076') HTTP/1.1" 204 0
2025-12-04 08:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIETTA?id=2939815&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232939815&indx=182> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ae5adda-d662-5517-bf59-4f4e341057e9 with identifier: 2939815
2025-12-04 08:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ae5adda-d662-5517-bf59-4f4e341057e9 with scrape type 2
2025-12-04 08:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ae5adda-d662-5517-bf59-4f4e341057e9 with scrape type 2
2025-12-04 08:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4ae5adda-d662-5517-bf59-4f4e341057e9, identifier: 2939815
2025-12-04 08:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4ae5adda-d662-5517-bf59-4f4e341057e9 with identifier: 2939815
2025-12-04 08:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4ae5adda-d662-5517-bf59-4f4e341057e9 with identifier: 2939815
2025-12-04 08:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 4ae5adda-d662-5517-bf59-4f4e341057e9 with identifier: 2939815 to the API
2025-12-04 08:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIETTA?id=2939815&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232939815&indx=182>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002939815-01982696-003.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4ae5adda-d662-5517-bf59-4f4e341057e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FE70ZVG',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIETTA?id=2939815',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'ALFA ROMEO',
 'model': 'GIULIETTA',
 'odometer': 16786,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-05',
 'seller_name': 'LSH Auto Group',
 'title': 'ALFA ROMEO GIULIETTA 1.4 TB Sprint 5dr',
 'transmission': 'manual',
 'trim': '1.4 TB Sprint 5dr',
 'year': 2020}
2025-12-04 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272939815%27 HTTP/1.1" 200 None
2025-12-04 08:03:11 [manheim.gb] INFO: Saving data for 2939815: {'auction_closing_time': 1764838800.0, 'created_time': 1764741799.633474, 'last_price_update_time': 1764835391.253328}
2025-12-04 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2939815') HTTP/1.1" 204 0
2025-12-04 08:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/LEAF?id=2896151&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232896151&indx=176> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/MOKKA?id=2936956&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232936956&indx=181> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERYSPORT?id=2893691&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232893691&indx=175> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75d5daf1-4a83-5ab2-94a8-a355c23ee501 with identifier: 2896151
2025-12-04 08:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75d5daf1-4a83-5ab2-94a8-a355c23ee501 with scrape type 2
2025-12-04 08:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75d5daf1-4a83-5ab2-94a8-a355c23ee501 with scrape type 2
2025-12-04 08:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 75d5daf1-4a83-5ab2-94a8-a355c23ee501, identifier: 2896151
2025-12-04 08:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 75d5daf1-4a83-5ab2-94a8-a355c23ee501 with identifier: 2896151
2025-12-04 08:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:03:11 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2025-12-04 08:03:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 75d5daf1-4a83-5ab2-94a8-a355c23ee501 with identifier: 2896151
2025-12-04 08:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'motonovo finance', 'price_includes_vat': False, 'title': 'nissan leaf 110kw tekna 40kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 41660, 'odometer_reading_unit': 'mi', 'registration_date': '2019-01-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2896151', 'location': 'shotts', 'origin_country_code': 'gb', 'trim': '110kw tekna 40kwh 5dr auto', 'license_plate': 'kf68zth', 'year': 2019, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002896151-01988633-004.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '75d5daf1-4a83-5ab2-94a8-a355c23ee501', 'current_year_diff': 6, 'age_in_months': 82, 'make_model': 'nissan leaf', 'sanitized_make': 'nissan', 'odometer_in_km': 67045} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 82,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002896151-01988633-004.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 6,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '75d5daf1-4a83-5ab2-94a8-a355c23ee501',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'kf68zth',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2896151',
     'listing': 'auction',
     'location': 'shotts',
     'make': 'nissan',
     'make_model': 'nissan leaf',
     'model': 'leaf',
     'odometer': 41660,
     'odometer_in_km': 67045,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-01-31',
     'sanitized_make': 'nissan',
     'seller_name': 'motonovo finance',
     'title': 'nissan leaf 110kw tekna 40kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '110kw tekna 40kwh 5dr auto',
     'year': 2019}
2025-12-04 08:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 75d5daf1-4a83-5ab2-94a8-a355c23ee501 spider: manheim.gb
2025-12-04 08:03:11 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 75d5daf1-4a83-5ab2-94a8-a355c23ee501 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'motonovo finance', 'price_includes_vat': False, 'title': 'nissan leaf 110kw tekna 40kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 41660, 'odometer_reading_unit': 'mi', 'registration_date': '2019-01-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2896151', 'location': 'shotts', 'origin_country_code': 'gb', 'trim': '110kw tekna 40kwh 5dr auto', 'license_plate': 'kf68zth', 'year': 2019, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002896151-01988633-004.pdf', 'expiration_date': '2025-12-09t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '75d5daf1-4a83-5ab2-94a8-a355c23ee501', 'current_year_diff': 6, 'age_in_months': 82, 'make_model': 'nissan leaf', 'sanitized_make': 'nissan', 'odometer_in_km': 67045} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 82,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002896151-01988633-004.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 6,
     'engine': '0.0l',
     'expiration_date': '2025-12-09t09:00:00z',
     'fuel_type': 'electric',
     'id': '75d5daf1-4a83-5ab2-94a8-a355c23ee501',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'kf68zth',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2896151',
     'listing': 'auction',
     'location': 'shotts',
     'make': 'nissan',
     'make_model': 'nissan leaf',
     'model': 'leaf',
     'odometer': 41660,
     'odometer_in_km': 67045,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-01-31',
     'sanitized_make': 'nissan',
     'seller_name': 'motonovo finance',
     'title': 'nissan leaf 110kw tekna 40kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '110kw tekna 40kwh 5dr auto',
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002896151-01988633-004.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '75d5daf1-4a83-5ab2-94a8-a355c23ee501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KF68ZTH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/LEAF?id=2896151',
 'listing': 'auction',
 'location': 'Shotts',
 'make': 'NISSAN',
 'model': 'LEAF',
 'odometer': 41660,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seller_name': 'MotoNovo Finance',
 'title': 'NISSAN LEAF 110kW Tekna 40kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '110kW Tekna 40kWh 5dr Auto',
 'year': 2019}
2025-12-04 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272896151%27 HTTP/1.1" 200 None
2025-12-04 08:03:11 [manheim.gb] INFO: Saving data for 2896151: {'auction_closing_time': 1765270800.0, 'created_time': 1764583477.707989, 'last_price_update_time': 1764835391.881074}
2025-12-04 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2896151') HTTP/1.1" 204 0
2025-12-04 08:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44df412c-3345-521c-9331-79ebb8a6946d with identifier: 2936956
2025-12-04 08:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44df412c-3345-521c-9331-79ebb8a6946d with scrape type 2
2025-12-04 08:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44df412c-3345-521c-9331-79ebb8a6946d with scrape type 2
2025-12-04 08:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 44df412c-3345-521c-9331-79ebb8a6946d, identifier: 2936956
2025-12-04 08:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e50fcc1-7dad-50a7-a08b-d3bc8e588772 with identifier: 2893691
2025-12-04 08:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e50fcc1-7dad-50a7-a08b-d3bc8e588772 with scrape type 2
2025-12-04 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e50fcc1-7dad-50a7-a08b-d3bc8e588772 with scrape type 2
2025-12-04 08:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 6e50fcc1-7dad-50a7-a08b-d3bc8e588772, identifier: 2893691
2025-12-04 08:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 44df412c-3345-521c-9331-79ebb8a6946d with identifier: 2936956
2025-12-04 08:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 44df412c-3345-521c-9331-79ebb8a6946d with identifier: 2936956
2025-12-04 08:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 0, 'seller_name': 'pentagon group', 'price_includes_vat': False, 'title': 'vauxhall mokka 100kw launch edition 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'mokka', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 20515, 'odometer_reading_unit': 'mi', 'registration_date': '2021-03-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/mokka?id=2936956', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '100kw launch edition 50kwh 5dr auto', 'license_plate': 'sw21doh', 'year': 2021, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002936956-01974977-003.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '44df412c-3345-521c-9331-79ebb8a6946d', 'current_year_diff': 4, 'age_in_months': 56, 'make_model': 'vauxhall mokka', 'sanitized_make': 'vauxhall', 'odometer_in_km': 33015} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 56,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002936956-01974977-003.pdf',
     'color': 'green',
     'currency': 'gbp',
     'current_year_diff': 4,
     'engine': '0.0l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'electric',
     'id': '44df412c-3345-521c-9331-79ebb8a6946d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'sw21doh',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/mokka?id=2936956',
     'listing': 'auction',
     'location': 'leeds',
     'make': 'vauxhall',
     'make_model': 'vauxhall mokka',
     'model': 'mokka',
     'odometer': 20515,
     'odometer_in_km': 33015,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-03-31',
     'sanitized_make': 'vauxhall',
     'seller_name': 'pentagon group',
     'title': 'vauxhall mokka 100kw launch edition 50kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw launch edition 50kwh 5dr auto',
     'year': 2021}
2025-12-04 08:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 44df412c-3345-521c-9331-79ebb8a6946d spider: manheim.gb
2025-12-04 08:03:12 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 44df412c-3345-521c-9331-79ebb8a6946d due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'green', 'original_photo_count': 0, 'seller_name': 'pentagon group', 'price_includes_vat': False, 'title': 'vauxhall mokka 100kw launch edition 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'mokka', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 20515, 'odometer_reading_unit': 'mi', 'registration_date': '2021-03-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/mokka?id=2936956', 'location': 'leeds', 'origin_country_code': 'gb', 'trim': '100kw launch edition 50kwh 5dr auto', 'license_plate': 'sw21doh', 'year': 2021, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002936956-01974977-003.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '44df412c-3345-521c-9331-79ebb8a6946d', 'current_year_diff': 4, 'age_in_months': 56, 'make_model': 'vauxhall mokka', 'sanitized_make': 'vauxhall', 'odometer_in_km': 33015} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 56,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002936956-01974977-003.pdf',
     'color': 'green',
     'currency': 'gbp',
     'current_year_diff': 4,
     'engine': '0.0l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'electric',
     'id': '44df412c-3345-521c-9331-79ebb8a6946d',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'sw21doh',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/vauxhall/mokka?id=2936956',
     'listing': 'auction',
     'location': 'leeds',
     'make': 'vauxhall',
     'make_model': 'vauxhall mokka',
     'model': 'mokka',
     'odometer': 20515,
     'odometer_in_km': 33015,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-03-31',
     'sanitized_make': 'vauxhall',
     'seller_name': 'pentagon group',
     'title': 'vauxhall mokka 100kw launch edition 50kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw launch edition 50kwh 5dr auto',
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002936956-01974977-003.pdf',
 'color': 'GREEN',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '44df412c-3345-521c-9331-79ebb8a6946d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SW21DOH',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/MOKKA?id=2936956',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'VAUXHALL',
 'model': 'MOKKA',
 'odometer': 20515,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seller_name': 'Pentagon Group',
 'title': 'VAUXHALL MOKKA 100kW Launch Edition 50kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW Launch Edition 50kWh 5dr Auto',
 'year': 2021}
2025-12-04 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272936956%27 HTTP/1.1" 200 None
2025-12-04 08:03:12 [manheim.gb] INFO: Saving data for 2936956: {'auction_closing_time': 1764838800.0, 'created_time': 1764741795.697098, 'last_price_update_time': 1764835392.444666}
2025-12-04 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2936956') HTTP/1.1" 204 0
2025-12-04 08:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 6e50fcc1-7dad-50a7-a08b-d3bc8e588772 with identifier: 2893691
2025-12-04 08:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:03:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Blue HTTP/1.1" 200 None
2025-12-04 08:03:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 6e50fcc1-7dad-50a7-a08b-d3bc8e588772 with identifier: 2893691
2025-12-04 08:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 134191 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    134191
2025-12-04 08:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 6e50fcc1-7dad-50a7-a08b-d3bc8e588772 spider: manheim.gb
2025-12-04 08:03:12 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 6e50fcc1-7dad-50a7-a08b-d3bc8e588772 due to rule: high_mileage_for_make.json, error: 134191 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    134191
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'car_expert_report_source_url': None,
 'color': 'Blue',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6e50fcc1-7dad-50a7-a08b-d3bc8e588772',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KP18YTC',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY%20SPORT?id=2893691',
 'listing': 'auction',
 'location': 'Colchester - In Transit',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT',
 'odometer': 83383,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE Black 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 180 HSE Black 5dr Auto',
 'year': 2018}
2025-12-04 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272893691%27 HTTP/1.1" 200 None
2025-12-04 08:03:12 [manheim.gb] INFO: Saving data for 2893691: {'auction_closing_time': 1765270800.0, 'created_time': 1764583559.280701, 'last_price_update_time': 1764835392.850658}
2025-12-04 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2893691') HTTP/1.1" 204 0
2025-12-04 08:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/CCLASS?id=2944079&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232944079&indx=183> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f89780c6-849e-5731-a797-a059e7e90159 with identifier: 2944079
2025-12-04 08:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f89780c6-849e-5731-a797-a059e7e90159 with scrape type 2
2025-12-04 08:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f89780c6-849e-5731-a797-a059e7e90159 with scrape type 2
2025-12-04 08:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f89780c6-849e-5731-a797-a059e7e90159, identifier: 2944079
2025-12-04 08:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f89780c6-849e-5731-a797-a059e7e90159 with identifier: 2944079
2025-12-04 08:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f89780c6-849e-5731-a797-a059e7e90159 with identifier: 2944079
2025-12-04 08:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f89780c6-849e-5731-a797-a059e7e90159 with identifier: 2944079 to the API
2025-12-04 08:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/CCLASS?id=2944079&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232944079&indx=183>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002944079-01990142-008.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'f89780c6-849e-5731-a797-a059e7e90159',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WX19OSC',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MERCEDES-BENZ/C%20CLASS?id=2944079',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS',
 'odometer': 89412,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-29',
 'seller_name': 'MotoNovo Finance',
 'title': 'MERCEDES-BENZ C CLASS C220d AMG Line Premium 5dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'C220d AMG Line Premium 5dr 9G-Tronic',
 'year': 2019}
2025-12-04 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272944079%27 HTTP/1.1" 200 None
2025-12-04 08:03:13 [manheim.gb] INFO: Saving data for 2944079: {'auction_closing_time': 1764838800.0, 'created_time': 1764741783.383254, 'last_price_update_time': 1764835393.479371}
2025-12-04 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2944079') HTTP/1.1" 204 0
2025-12-04 08:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ADAM?id=2891297&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232891297&indx=174> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9d949ef-5973-5c56-a04d-fb8c1f7be0a5 with identifier: 2891297
2025-12-04 08:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9d949ef-5973-5c56-a04d-fb8c1f7be0a5 with scrape type 2
2025-12-04 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9d949ef-5973-5c56-a04d-fb8c1f7be0a5 with scrape type 2
2025-12-04 08:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: c9d949ef-5973-5c56-a04d-fb8c1f7be0a5, identifier: 2891297
2025-12-04 08:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: c9d949ef-5973-5c56-a04d-fb8c1f7be0a5 with identifier: 2891297
2025-12-04 08:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: c9d949ef-5973-5c56-a04d-fb8c1f7be0a5 with identifier: 2891297
2025-12-04 08:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184842 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184842
2025-12-04 08:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c9d949ef-5973-5c56-a04d-fb8c1f7be0a5 spider: manheim.gb
2025-12-04 08:03:15 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: c9d949ef-5973-5c56-a04d-fb8c1f7be0a5 due to rule: high_mileage_for_country.json, error: 184842 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184842
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002891297-01950891-002.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c9d949ef-5973-5c56-a04d-fb8c1f7be0a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SM63JJZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VAUXHALL/ADAM?id=2891297',
 'listing': 'directbuy',
 'location': 'Leeds',
 'make': 'VAUXHALL',
 'model': 'ADAM',
 'odometer': 114856,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-21',
 'seller_name': 'Lloyd Motor Group',
 'title': 'VAUXHALL ADAM 1.2i Glam 3dr',
 'transmission': 'manual',
 'trim': '1.2i Glam 3dr',
 'year': 2014}
2025-12-04 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272891297%27 HTTP/1.1" 200 None
2025-12-04 08:03:15 [manheim.gb] INFO: Saving data for 2891297: {'auction_closing_time': 1765184400.0, 'created_time': 1764583517.019943, 'last_price_update_time': 1764835395.910341}
2025-12-04 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2891297') HTTP/1.1" 204 0
2025-12-04 08:03:20 [scrapy.extensions.logstats] INFO: Crawled 37 pages (at 17 pages/min), scraped 10 items (at 6 items/min)
2025-12-04 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=2727315&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232727315&indx=159> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf5fdb7c-c144-54c8-9dd2-7478f85e3ced with identifier: 2727315
2025-12-04 08:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf5fdb7c-c144-54c8-9dd2-7478f85e3ced with scrape type 2
2025-12-04 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf5fdb7c-c144-54c8-9dd2-7478f85e3ced with scrape type 2
2025-12-04 08:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cf5fdb7c-c144-54c8-9dd2-7478f85e3ced, identifier: 2727315
2025-12-04 08:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cf5fdb7c-c144-54c8-9dd2-7478f85e3ced with identifier: 2727315
2025-12-04 08:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cf5fdb7c-c144-54c8-9dd2-7478f85e3ced with identifier: 2727315
2025-12-04 08:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: cf5fdb7c-c144-54c8-9dd2-7478f85e3ced with identifier: 2727315 to the API
2025-12-04 08:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=2727315&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232727315&indx=159>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002727315-01976941-002.pdf',
 'color': 'GREEN',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cf5fdb7c-c144-54c8-9dd2-7478f85e3ced',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RJ17UVR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/MINI/HATCHBACK?id=2727315',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 45980,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-16',
 'seller_name': None,
 'title': 'MINI HATCHBACK 1.2 One 5dr',
 'transmission': 'manual',
 'trim': '1.2 One 5dr',
 'year': 2017}
2025-12-04 08:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272727315%27 HTTP/1.1" 200 None
2025-12-04 08:03:28 [manheim.gb] INFO: Saving data for 2727315: {'auction_closing_time': 1764838800.0, 'created_time': 1764583776.027964, 'last_price_update_time': 1764835408.661055}
2025-12-04 08:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2727315') HTTP/1.1" 204 0
2025-12-04 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/LEAF?id=2778685&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232778685&indx=167> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6793067-61c7-5b78-a020-56b7086c899f with identifier: 2778685
2025-12-04 08:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6793067-61c7-5b78-a020-56b7086c899f with scrape type 2
2025-12-04 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6793067-61c7-5b78-a020-56b7086c899f with scrape type 2
2025-12-04 08:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d6793067-61c7-5b78-a020-56b7086c899f, identifier: 2778685
2025-12-04 08:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d6793067-61c7-5b78-a020-56b7086c899f with identifier: 2778685
2025-12-04 08:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d6793067-61c7-5b78-a020-56b7086c899f with identifier: 2778685
2025-12-04 08:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'mobilize financial services', 'price_includes_vat': False, 'title': 'nissan leaf 80kw acenta 24kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 59124, 'odometer_reading_unit': 'mi', 'registration_date': '2014-07-24', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2778685', 'location': 'leeds - in transit', 'origin_country_code': 'gb', 'trim': '80kw acenta 24kwh 5dr auto', 'license_plate': 'lo14svz', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002778685-01988702-001.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'd6793067-61c7-5b78-a020-56b7086c899f', 'current_year_diff': 11, 'age_in_months': 136, 'make_model': 'nissan leaf', 'sanitized_make': 'nissan', 'odometer_in_km': 95150} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 136,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002778685-01988702-001.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '0.0l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'electric',
     'id': 'd6793067-61c7-5b78-a020-56b7086c899f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'lo14svz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2778685',
     'listing': 'auction',
     'location': 'leeds - in transit',
     'make': 'nissan',
     'make_model': 'nissan leaf',
     'model': 'leaf',
     'odometer': 59124,
     'odometer_in_km': 95150,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-07-24',
     'sanitized_make': 'nissan',
     'seller_name': 'mobilize financial services',
     'title': 'nissan leaf 80kw acenta 24kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '80kw acenta 24kwh 5dr auto',
     'year': 2014}
2025-12-04 08:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: d6793067-61c7-5b78-a020-56b7086c899f spider: manheim.gb
2025-12-04 08:03:37 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: d6793067-61c7-5b78-a020-56b7086c899f due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'mobilize financial services', 'price_includes_vat': False, 'title': 'nissan leaf 80kw acenta 24kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 59124, 'odometer_reading_unit': 'mi', 'registration_date': '2014-07-24', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2778685', 'location': 'leeds - in transit', 'origin_country_code': 'gb', 'trim': '80kw acenta 24kwh 5dr auto', 'license_plate': 'lo14svz', 'year': 2014, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002778685-01988702-001.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'd6793067-61c7-5b78-a020-56b7086c899f', 'current_year_diff': 11, 'age_in_months': 136, 'make_model': 'nissan leaf', 'sanitized_make': 'nissan', 'odometer_in_km': 95150} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 136,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002778685-01988702-001.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 11,
     'engine': '0.0l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'electric',
     'id': 'd6793067-61c7-5b78-a020-56b7086c899f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'lo14svz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2778685',
     'listing': 'auction',
     'location': 'leeds - in transit',
     'make': 'nissan',
     'make_model': 'nissan leaf',
     'model': 'leaf',
     'odometer': 59124,
     'odometer_in_km': 95150,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2014-07-24',
     'sanitized_make': 'nissan',
     'seller_name': 'mobilize financial services',
     'title': 'nissan leaf 80kw acenta 24kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '80kw acenta 24kwh 5dr auto',
     'year': 2014}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002778685-01988702-001.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Electric',
 'id': 'd6793067-61c7-5b78-a020-56b7086c899f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LO14SVZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/LEAF?id=2778685',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'make': 'NISSAN',
 'model': 'LEAF',
 'odometer': 59124,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-24',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN LEAF 80kW Acenta 24kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '80kW Acenta 24kWh 5dr Auto',
 'year': 2014}
2025-12-04 08:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272778685%27 HTTP/1.1" 200 None
2025-12-04 08:03:37 [manheim.gb] INFO: Saving data for 2778685: {'auction_closing_time': 1765184400.0, 'created_time': 1764583669.394007, 'last_price_update_time': 1764835417.618295}
2025-12-04 08:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2778685') HTTP/1.1" 204 0
2025-12-04 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=3528421&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233528421&indx=281> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cabc01c0-d6ee-5553-b97b-54efad114c13 with identifier: 3528421
2025-12-04 08:03:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2688065&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232688065&indx=156> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba680a31-8554-5b07-8e77-10102820d632 with identifier: 2688065
2025-12-04 08:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba680a31-8554-5b07-8e77-10102820d632 with scrape type 2
2025-12-04 08:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba680a31-8554-5b07-8e77-10102820d632 with scrape type 2
2025-12-04 08:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: ba680a31-8554-5b07-8e77-10102820d632, identifier: 2688065
2025-12-04 08:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: ba680a31-8554-5b07-8e77-10102820d632 with identifier: 2688065
2025-12-04 08:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: ba680a31-8554-5b07-8e77-10102820d632 with identifier: 2688065
2025-12-04 08:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: ba680a31-8554-5b07-8e77-10102820d632 with identifier: 2688065 to the API
2025-12-04 08:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2688065&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232688065&indx=156>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002688065-01959046-003.pdf',
 'color': 'GREEN',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ba680a31-8554-5b07-8e77-10102820d632',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SG16MMF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=2688065',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'FIAT',
 'model': '500',
 'odometer': 49737,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-20',
 'seller_name': 'Motor Dough',
 'title': 'FIAT 500 1.2 Pop Star 3dr',
 'transmission': 'manual',
 'trim': '1.2 Pop Star 3dr',
 'year': 2016}
2025-12-04 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272688065%27 HTTP/1.1" 200 None
2025-12-04 08:03:41 [manheim.gb] INFO: Saving data for 2688065: {'auction_closing_time': 1764838800.0, 'created_time': 1764583714.208909, 'last_price_update_time': 1764835421.471956}
2025-12-04 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2688065') HTTP/1.1" 204 0
2025-12-04 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf> (referer: None)
2025-12-04 08:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c9b61d0>
2025-12-04 08:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_expert_report_file_7460bb9f-f12c-4bab-8610-5dcfbeff7987.pdf HTTP/1.1" 201 0
2025-12-04 08:03:42 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:03:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cabc01c0-d6ee-5553-b97b-54efad114c13, skipping ID generation
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_7.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_7.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_6.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_1.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_5.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_4.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_11.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_10.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_9.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_2.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_5.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_3.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_4.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3528421-4001618-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-13.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3528421-4001618-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1000.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3528421-4001618-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1001.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3528421-4001618-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1002.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3528421-4001618-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1003.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3528421-4001618-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1004.jpg not downloaded yet
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3528421-4001618-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1005.jpg not downloaded yet
2025-12-04 08:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=3553764&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233553764&indx=284> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1 with identifier: 3553764
2025-12-04 08:03:44 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLVO/XC40?id=3544627&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233544627&indx=283> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cb12490>
2025-12-04 08:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_19.jpg HTTP/1.1" 201 0
2025-12-04 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3528421-4001618-1005.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1005.jpg saved to cache
2025-12-04 08:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f10c6e7a-5082-5236-bb28-35f7a23e2e5b with identifier: 3544627
2025-12-04 08:03:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f10c6e7a-5082-5236-bb28-35f7a23e2e5b
2025-12-04 08:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:03:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cc096d0>
2025-12-04 08:03:45 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_18.jpg HTTP/1.1" 201 0
2025-12-04 08:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3528421-4001618-1004.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1004.jpg saved to cache
2025-12-04 08:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf> (referer: None)
2025-12-04 08:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c4e3f50>
2025-12-04 08:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_expert_report_file_56f42378-0c86-4cda-a46f-d5bf3bbeb39b.pdf HTTP/1.1" 201 0
2025-12-04 08:03:47 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:03:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1, skipping ID generation
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_7.jpg not downloaded yet
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_7.jpg not downloaded yet
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_6.jpg not downloaded yet
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_1.jpg not downloaded yet
2025-12-04 08:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_5.jpg not downloaded yet
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_4.jpg not downloaded yet
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_11.jpg not downloaded yet
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_10.jpg not downloaded yet
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_9.jpg not downloaded yet
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_2.jpg not downloaded yet
2025-12-04 08:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cd07a50>
2025-12-04 08:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_17.jpg HTTP/1.1" 201 0
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3528421-4001618-1003.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1003.jpg saved to cache
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_5.jpg not downloaded yet
2025-12-04 08:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=352448&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%23352448&indx=280> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_3.jpg not downloaded yet
2025-12-04 08:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_4.jpg not downloaded yet
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3553764-3933551-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3933551-13.jpg not downloaded yet
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3553764-3925412-16.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-16.jpg not downloaded yet
2025-12-04 08:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c4b074f-bc85-5b64-ab3a-e59b7472db38 with identifier: 352448
2025-12-04 08:03:47 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3553764-3925412-28.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-28.jpg not downloaded yet
2025-12-04 08:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cdf6950>
2025-12-04 08:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_3.jpg HTTP/1.1" 201 0
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_1.jpg saved to cache
2025-12-04 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003544627-01961353-002.pdf> (referer: None)
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3553764-3925412-42.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-42.jpg not downloaded yet
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3553764-3925412-43.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-43.jpg not downloaded yet
2025-12-04 08:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3553764-3933551-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3933551-1000.jpg not downloaded yet
2025-12-04 08:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3553764-3933551-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3933551-1001.jpg not downloaded yet
2025-12-04 08:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cc75150>
2025-12-04 08:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_expert_report_file_7968ac34-05db-4524-bfb5-e59d5829ccba.pdf HTTP/1.1" 201 0
2025-12-04 08:03:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f10c6e7a-5082-5236-bb28-35f7a23e2e5b
2025-12-04 08:03:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f10c6e7a-5082-5236-bb28-35f7a23e2e5b, skipping ID generation
2025-12-04 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item f10c6e7a-5082-5236-bb28-35f7a23e2e5b
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965dc763-f379-46ec-8422-6070bdc6c1bf_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_7.jpg already downloaded
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965dc763-f379-46ec-8422-6070bdc6c1bf_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_7.jpg already downloaded
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965dc763-f379-46ec-8422-6070bdc6c1bf_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_6.jpg already downloaded
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965dc763-f379-46ec-8422-6070bdc6c1bf_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_1.jpg already downloaded
2025-12-04 08:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965dc763-f379-46ec-8422-6070bdc6c1bf_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_5.jpg already downloaded
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965dc763-f379-46ec-8422-6070bdc6c1bf_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_4.jpg already downloaded
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965dc763-f379-46ec-8422-6070bdc6c1bf_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_11.jpg already downloaded
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965dc763-f379-46ec-8422-6070bdc6c1bf_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_10.jpg already downloaded
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965dc763-f379-46ec-8422-6070bdc6c1bf_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_9.jpg already downloaded
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965dc763-f379-46ec-8422-6070bdc6c1bf_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_2.jpg already downloaded
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965dc763-f379-46ec-8422-6070bdc6c1bf_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_5.jpg already downloaded
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965dc763-f379-46ec-8422-6070bdc6c1bf_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_3.jpg already downloaded
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F965dc763-f379-46ec-8422-6070bdc6c1bf_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_4.jpg already downloaded
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3544627-3974917-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-13.jpg already downloaded
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3544627-3974917-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1000.jpg already downloaded
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3544627-3974917-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1001.jpg already downloaded
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3544627-3974917-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1002.jpg already downloaded
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3544627-3974917-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1003.jpg already downloaded
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3544627-3974917-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1004.jpg already downloaded
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3544627-3974917-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1005.jpg already downloaded
2025-12-04 08:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: f10c6e7a-5082-5236-bb28-35f7a23e2e5b, identifier: 3544627
2025-12-04 08:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: f10c6e7a-5082-5236-bb28-35f7a23e2e5b with identifier: 3544627
2025-12-04 08:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: f10c6e7a-5082-5236-bb28-35f7a23e2e5b with identifier: 3544627
2025-12-04 08:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: f10c6e7a-5082-5236-bb28-35f7a23e2e5b with identifier: 3544627 to the API
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003544627-01961353-002.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_expert_report_file_7968ac34-05db-4524-bfb5-e59d5829ccba.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003544627-01961353-002.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f10c6e7a-5082-5236-bb28-35f7a23e2e5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ST70XVP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLVO/XC40?id=3544627',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'VOLVO',
 'model': 'XC40',
 'odometer': 15091,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 27,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192593,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 192593,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 179861,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142554,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184109,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193202,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 184341,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 190505,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211380,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213511,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193014,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215535,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195738,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/965dc763-f379-46ec-8422-6070bdc6c1bf_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 304591,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 185754,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 284648,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282399,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 243371,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 382925,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f10c6e7a-5082-5236-bb28-35f7a23e2e5b/f10c6e7a-5082-5236-bb28-35f7a23e2e5b_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 375553,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3544627-3974917-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-15',
 'seller_name': 'Brindley Group',
 'title': 'VOLVO XC40 1.5 T3 [163] Inscription 5dr',
 'transmission': 'manual',
 'trim': '1.5 T3 [163] Inscription 5dr',
 'year': 2021}
2025-12-04 08:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273544627%27 HTTP/1.1" 200 None
2025-12-04 08:03:50 [manheim.gb] INFO: Saving data for 3544627: {'created_time': 1764835430.009579, 'last_price_update_time': 1764835430.009597, 'auction_closing_time': 1764925200.0}
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3544627') HTTP/1.1" 204 0
2025-12-04 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/SUZUKI/SWIFT?id=3542461&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233542461&indx=282> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c340090>
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_11.jpg HTTP/1.1" 201 0
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_3.jpg saved to cache
2025-12-04 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cbd1c10>
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_10.jpg HTTP/1.1" 201 0
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_5.jpg saved to cache
2025-12-04 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-43.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3933551-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd818e38-b46f-5fcc-91d6-e99baef3d76e with identifier: 3542461
2025-12-04 08:03:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item dd818e38-b46f-5fcc-91d6-e99baef3d76e
2025-12-04 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-28.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cbc1b10>
2025-12-04 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_17.jpg HTTP/1.1" 201 0
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3553764-3925412-43.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-43.jpg saved to cache
2025-12-04 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-42.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c97d450>
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_18.jpg HTTP/1.1" 201 0
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3553764-3933551-1000.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3933551-1000.jpg saved to cache
2025-12-04 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52ca482d0>
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_15.jpg HTTP/1.1" 201 0
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3553764-3925412-28.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-28.jpg saved to cache
2025-12-04 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cc34f50>
2025-12-04 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_16.jpg HTTP/1.1" 201 0
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3553764-3925412-42.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-42.jpg saved to cache
2025-12-04 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3933551-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-16.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf> (referer: None)
2025-12-04 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003542461-01518082-002.pdf> (referer: None)
2025-12-04 08:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c968a50>
2025-12-04 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_19.jpg HTTP/1.1" 201 0
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3553764-3933551-1001.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3933551-1001.jpg saved to cache
2025-12-04 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cbbf4d0>
2025-12-04 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_14.jpg HTTP/1.1" 201 0
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3553764-3925412-16.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-16.jpg saved to cache
2025-12-04 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52ccdd750>
2025-12-04 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_expert_report_file_074dd3e4-2c25-4ae0-afe0-db52ac8c5df7.pdf HTTP/1.1" 201 0
2025-12-04 08:03:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:03:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c4b074f-bc85-5b64-ab3a-e59b7472db38, skipping ID generation
2025-12-04 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_7.jpg not downloaded yet
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_7.jpg not downloaded yet
2025-12-04 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c94b710>
2025-12-04 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd818e38-b46f-5fcc-91d6-e99baef3d76e/dd818e38-b46f-5fcc-91d6-e99baef3d76e_expert_report_file_e9e88e8d-62d5-42b6-a5c0-83069f59bd2b.pdf HTTP/1.1" 201 0
2025-12-04 08:03:54 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item dd818e38-b46f-5fcc-91d6-e99baef3d76e
2025-12-04 08:03:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd818e38-b46f-5fcc-91d6-e99baef3d76e, skipping ID generation
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item dd818e38-b46f-5fcc-91d6-e99baef3d76e
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_7.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_7.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_6.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_1.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9da2a31-9ae9-40ad-b89a-1d7eba7e0664_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_5.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9da2a31-9ae9-40ad-b89a-1d7eba7e0664_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_4.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9da2a31-9ae9-40ad-b89a-1d7eba7e0664_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_11.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9da2a31-9ae9-40ad-b89a-1d7eba7e0664_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_10.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9da2a31-9ae9-40ad-b89a-1d7eba7e0664_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_9.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_2.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_5.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_3.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_4.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3542461-3966299-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-13.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3542461-3966299-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1000.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3542461-3966299-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1001.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3542461-3966299-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1002.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3542461-3966299-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1003.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3542461-3966299-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1004.jpg already downloaded
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3542461-3966299-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1005.jpg already downloaded
2025-12-04 08:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: dd818e38-b46f-5fcc-91d6-e99baef3d76e, identifier: 3542461
2025-12-04 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3933551-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_6.jpg not downloaded yet
2025-12-04 08:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: dd818e38-b46f-5fcc-91d6-e99baef3d76e with identifier: 3542461
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:03:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FHybrid HTTP/1.1" 200 None
2025-12-04 08:03:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: dd818e38-b46f-5fcc-91d6-e99baef3d76e with identifier: 3542461
2025-12-04 08:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: dd818e38-b46f-5fcc-91d6-e99baef3d76e with identifier: 3542461 to the API
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 http://ecr.manheim.co.uk/pdf/MOL-0003542461-01518082-002.pdf>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd818e38-b46f-5fcc-91d6-e99baef3d76e/dd818e38-b46f-5fcc-91d6-e99baef3d76e_expert_report_file_e9e88e8d-62d5-42b6-a5c0-83069f59bd2b.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003542461-01518082-002.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol/Hybrid',
 'id': 'dd818e38-b46f-5fcc-91d6-e99baef3d76e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YG17CSB',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SUZUKI/SWIFT?id=3542461',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'SUZUKI',
 'model': 'SWIFT',
 'odometer': 39258,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 40,
 'photo_urls': ['http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_7.jpg',
                'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_6.jpg',
                'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_1.jpg',
                'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_11.jpg',
                'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_10.jpg',
                'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_9.jpg',
                'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_2.jpg',
                'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_5.jpg',
                'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_3.jpg',
                'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_4.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-13.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1000.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1001.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1002.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1003.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1004.jpg',
                'http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1005.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e239417b-d01a-507b-a157-c6ef6f66f1f1/e239417b-d01a-507b-a157-c6ef6f66f1f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193502,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e239417b-d01a-507b-a157-c6ef6f66f1f1/e239417b-d01a-507b-a157-c6ef6f66f1f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 193502,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e239417b-d01a-507b-a157-c6ef6f66f1f1/e239417b-d01a-507b-a157-c6ef6f66f1f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 248295,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e239417b-d01a-507b-a157-c6ef6f66f1f1/e239417b-d01a-507b-a157-c6ef6f66f1f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 234969,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e239417b-d01a-507b-a157-c6ef6f66f1f1/e239417b-d01a-507b-a157-c6ef6f66f1f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195736,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e239417b-d01a-507b-a157-c6ef6f66f1f1/e239417b-d01a-507b-a157-c6ef6f66f1f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195073,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e239417b-d01a-507b-a157-c6ef6f66f1f1/e239417b-d01a-507b-a157-c6ef6f66f1f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 196499,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e239417b-d01a-507b-a157-c6ef6f66f1f1/e239417b-d01a-507b-a157-c6ef6f66f1f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195693,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e239417b-d01a-507b-a157-c6ef6f66f1f1/e239417b-d01a-507b-a157-c6ef6f66f1f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 195405,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e239417b-d01a-507b-a157-c6ef6f66f1f1/e239417b-d01a-507b-a157-c6ef6f66f1f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 296486,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e239417b-d01a-507b-a157-c6ef6f66f1f1/e239417b-d01a-507b-a157-c6ef6f66f1f1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289935,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e239417b-d01a-507b-a157-c6ef6f66f1f1/e239417b-d01a-507b-a157-c6ef6f66f1f1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 278194,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e239417b-d01a-507b-a157-c6ef6f66f1f1/e239417b-d01a-507b-a157-c6ef6f66f1f1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 314568,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e9da2a31-9ae9-40ad-b89a-1d7eba7e0664_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd818e38-b46f-5fcc-91d6-e99baef3d76e/dd818e38-b46f-5fcc-91d6-e99baef3d76e_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336197,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd818e38-b46f-5fcc-91d6-e99baef3d76e/dd818e38-b46f-5fcc-91d6-e99baef3d76e_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 322924,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd818e38-b46f-5fcc-91d6-e99baef3d76e/dd818e38-b46f-5fcc-91d6-e99baef3d76e_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289396,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd818e38-b46f-5fcc-91d6-e99baef3d76e/dd818e38-b46f-5fcc-91d6-e99baef3d76e_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 330972,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd818e38-b46f-5fcc-91d6-e99baef3d76e/dd818e38-b46f-5fcc-91d6-e99baef3d76e_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246288,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd818e38-b46f-5fcc-91d6-e99baef3d76e/dd818e38-b46f-5fcc-91d6-e99baef3d76e_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225150,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd818e38-b46f-5fcc-91d6-e99baef3d76e/dd818e38-b46f-5fcc-91d6-e99baef3d76e_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 299364,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3542461-3966299-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-17',
 'seller_name': 'MotoNovo Finance',
 'title': 'SUZUKI SWIFT 1.0 Boosterjet SHVS SZ5 5dr',
 'transmission': 'manual',
 'trim': '1.0 Boosterjet SHVS SZ5 5dr',
 'year': 2017}
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273542461%27 HTTP/1.1" 200 None
2025-12-04 08:03:55 [manheim.gb] INFO: Saving data for 3542461: {'created_time': 1764835435.440608, 'last_price_update_time': 1764835435.440619, 'auction_closing_time': 1764838800.0}
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3542461') HTTP/1.1" 204 0
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_1.jpg not downloaded yet
2025-12-04 08:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cdd7010>
2025-12-04 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_9.jpg HTTP/1.1" 201 0
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_2.jpg saved to cache
2025-12-04 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cee67d0>
2025-12-04 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_13.jpg HTTP/1.1" 201 0
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3553764-3933551-13.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3933551-13.jpg saved to cache
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cef0050>
2025-12-04 08:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_12.jpg HTTP/1.1" 201 0
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_4.jpg saved to cache
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_5.jpg not downloaded yet
2025-12-04 08:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=3518224&returnUrl=%2Fsearch%3FPage%3D3%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%233518224&indx=279> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_4.jpg not downloaded yet
2025-12-04 08:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_11.jpg not downloaded yet
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_10.jpg not downloaded yet
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_9.jpg not downloaded yet
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_2.jpg not downloaded yet
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_5.jpg not downloaded yet
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_3.jpg not downloaded yet
2025-12-04 08:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb113377-2fab-5ec7-b02d-6df30f08e5d8 with identifier: 3518224
2025-12-04 08:03:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_4.jpg not downloaded yet
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-352448-3999453-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-13.jpg not downloaded yet
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-352448-3999453-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1000.jpg not downloaded yet
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-352448-3999453-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1001.jpg not downloaded yet
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-352448-3999453-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1002.jpg not downloaded yet
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-352448-3999453-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1003.jpg not downloaded yet
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-352448-3999453-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1004.jpg not downloaded yet
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-352448-3999453-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1005.jpg not downloaded yet
2025-12-04 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c979ad0>
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_0.jpg HTTP/1.1" 201 0
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_7.jpg saved to cache
2025-12-04 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cb20f50>
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_4.jpg HTTP/1.1" 201 0
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_5.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_5.jpg saved to cache
2025-12-04 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cbf6190>
2025-12-04 08:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_1.jpg HTTP/1.1" 201 0
2025-12-04 08:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_7.jpg saved to cache
2025-12-04 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cb86ed0>
2025-12-04 08:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_3.jpg HTTP/1.1" 201 0
2025-12-04 08:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_1.jpg saved to cache
2025-12-04 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cf16310>
2025-12-04 08:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_2.jpg HTTP/1.1" 201 0
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_6.jpg saved to cache
2025-12-04 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cee7190>
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_19.jpg HTTP/1.1" 201 0
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-352448-3999453-1005.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1005.jpg saved to cache
2025-12-04 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cbbf150>
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_18.jpg HTTP/1.1" 201 0
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-352448-3999453-1004.jpg') HTTP/1.1" 204 0
2025-12-04 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1004.jpg saved to cache
2025-12-04 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c4e0dd0>
2025-12-04 08:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_16.jpg HTTP/1.1" 201 0
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-352448-3999453-1002.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1002.jpg saved to cache
2025-12-04 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c3d5190>
2025-12-04 08:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_14.jpg HTTP/1.1" 201 0
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-352448-3999453-1000.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1000.jpg saved to cache
2025-12-04 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cc68e10>
2025-12-04 08:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_17.jpg HTTP/1.1" 201 0
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-352448-3999453-1003.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1003.jpg saved to cache
2025-12-04 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cdb1910>
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 08:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_15.jpg HTTP/1.1" 201 0
2025-12-04 08:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-352448-3999453-1001.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1001.jpg saved to cache
2025-12-04 08:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52ce02550>
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_12.jpg HTTP/1.1" 201 0
2025-12-04 08:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_4.jpg saved to cache
2025-12-04 08:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c362450>
2025-12-04 08:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_13.jpg HTTP/1.1" 201 0
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-352448-3999453-13.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-13.jpg saved to cache
2025-12-04 08:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c9696d0>
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_10.jpg HTTP/1.1" 201 0
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_5.jpg saved to cache
2025-12-04 08:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52e228950>
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_11.jpg HTTP/1.1" 201 0
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_3.jpg saved to cache
2025-12-04 08:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cc1b7d0>
2025-12-04 08:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_9.jpg HTTP/1.1" 201 0
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_2.jpg saved to cache
2025-12-04 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cc89ad0>
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_8.jpg HTTP/1.1" 201 0
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_9.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_9.jpg saved to cache
2025-12-04 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf)
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cc43990>
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_7.jpg HTTP/1.1" 201 0
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_10.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_10.jpg saved to cache
2025-12-04 08:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cbbdbd0>
2025-12-04 08:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_6.jpg HTTP/1.1" 201 0
2025-12-04 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_11.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_11.jpg saved to cache
2025-12-04 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cc197d0>
2025-12-04 08:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_8.jpg HTTP/1.1" 201 0
2025-12-04 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_9.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_9.jpg saved to cache
2025-12-04 08:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cee4fd0>
2025-12-04 08:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_5.jpg HTTP/1.1" 201 0
2025-12-04 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F99735484-48a9-4388-9496-437181a852b7_4.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_4.jpg saved to cache
2025-12-04 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38
2025-12-04 08:04:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c4b074f-bc85-5b64-ab3a-e59b7472db38, skipping ID generation
2025-12-04 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4c4b074f-bc85-5b64-ab3a-e59b7472db38 from tracking dictionaries
2025-12-04 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c4b074f-bc85-5b64-ab3a-e59b7472db38 sending to next pipeline
2025-12-04 08:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 4c4b074f-bc85-5b64-ab3a-e59b7472db38, identifier: 352448
2025-12-04 08:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 4c4b074f-bc85-5b64-ab3a-e59b7472db38 with identifier: 352448
2025-12-04 08:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 4c4b074f-bc85-5b64-ab3a-e59b7472db38 with identifier: 352448
2025-12-04 08:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
2025-12-04 08:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 4c4b074f-bc85-5b64-ab3a-e59b7472db38 spider: manheim.gb
2025-12-04 08:04:05 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 4c4b074f-bc85-5b64-ab3a-e59b7472db38 due to rule: registration_date_old.json, error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_expert_report_file_074dd3e4-2c25-4ae0-afe0-db52ac8c5df7.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0000352448-01984095-003.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '4c4b074f-bc85-5b64-ab3a-e59b7472db38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PN62ZDR',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=352448',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 86178,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 44,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207135,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 207135,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168242,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 189181,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203084,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208773,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 204299,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 217349,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 220305,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211405,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 160206,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 203118,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 219666,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/99735484-48a9-4388-9496-437181a852b7_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 316607,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135360,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272924,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123695,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 156026,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 186411,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c4b074f-bc85-5b64-ab3a-e59b7472db38/4c4b074f-bc85-5b64-ab3a-e59b7472db38_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200105,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-352448-3999453-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-19',
 'seller_name': 'Arbury',
 'title': 'NISSAN QASHQAI 1.5 dCi [110] Acenta 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi [110] Acenta 5dr',
 'year': 2012}
2025-12-04 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27352448%27 HTTP/1.1" 200 None
2025-12-04 08:04:05 [manheim.gb] INFO: Saving data for 352448: {'created_time': 1764835445.817858, 'last_price_update_time': 1764835445.817873, 'auction_closing_time': 1764925200.0}
2025-12-04 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='352448') HTTP/1.1" 204 0
2025-12-04 08:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52e1c98d0>
2025-12-04 08:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_7.jpg HTTP/1.1" 201 0
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_10.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_10.jpg saved to cache
2025-12-04 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52ccaccd0>
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_6.jpg HTTP/1.1" 201 0
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_11.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_11.jpg saved to cache
2025-12-04 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c3d52d0>
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_5.jpg HTTP/1.1" 201 0
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_4.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_4.jpg saved to cache
2025-12-04 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cd9dd10>
2025-12-04 08:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_4.jpg HTTP/1.1" 201 0
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_5.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_5.jpg saved to cache
2025-12-04 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf)
2025-12-04 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cdc9290>
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_1.jpg HTTP/1.1" 201 0
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_7.jpg saved to cache
2025-12-04 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cd6a9d0>
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_2.jpg HTTP/1.1" 201 0
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_6.jpg saved to cache
2025-12-04 08:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C4CACTUS?id=2667513&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232667513&indx=155> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/SKODA/FABIA?id=2664010&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232664010&indx=154> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:04:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cd67090>
2025-12-04 08:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_0.jpg HTTP/1.1" 201 0
2025-12-04 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1710e548-85ec-4c06-b07b-6162f41f862f_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_7.jpg saved to cache
2025-12-04 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1
2025-12-04 08:04:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1, skipping ID generation
2025-12-04 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1 from tracking dictionaries
2025-12-04 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1 sending to next pipeline
2025-12-04 08:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1, identifier: 3553764
2025-12-04 08:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cd205d0>
2025-12-04 08:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_15.jpg HTTP/1.1" 201 0
2025-12-04 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3528421-4001618-1001.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1001.jpg saved to cache
2025-12-04 08:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf> (referer: None)
2025-12-04 08:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1 with identifier: 3553764
2025-12-04 08:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1 with identifier: 3553764
2025-12-04 08:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 8f00c4f3-ff0b-55a3-b2dc-974c10443ae1 with identifier: 3553764 to the API
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_expert_report_file_56f42378-0c86-4cda-a46f-d5bf3bbeb39b.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003553764-01931792-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8f00c4f3-ff0b-55a3-b2dc-974c10443ae1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'WO21TZP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=3553764',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'FIAT',
 'model': '500',
 'odometer': 42723,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 37,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199180,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 199180,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 270192,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 246469,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 171891,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 172567,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 168728,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 178937,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 188476,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 249256,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201541,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210175,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 311215,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1710e548-85ec-4c06-b07b-6162f41f862f_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 272243,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3933551-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 277877,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-16.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 376911,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-28.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 255419,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-42.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276911,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3925412-43.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 380855,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3933551-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f00c4f3-ff0b-55a3-b2dc-974c10443ae1/8f00c4f3-ff0b-55a3-b2dc-974c10443ae1_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 313511,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3553764-3933551-1001.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seller_name': 'Leasys',
 'title': 'FIAT 500 1.0 Mild Hybrid Pop 3dr',
 'transmission': 'manual',
 'trim': '1.0 Mild Hybrid Pop 3dr',
 'year': 2021}
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273553764%27 HTTP/1.1" 200 None
2025-12-04 08:04:09 [manheim.gb] INFO: Saving data for 3553764: {'created_time': 1764835449.334291, 'last_price_update_time': 1764835449.334304, 'auction_closing_time': 1765184400.0}
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3553764') HTTP/1.1" 204 0
2025-12-04 08:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c3b8dd0>
2025-12-04 08:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_16.jpg HTTP/1.1" 201 0
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3528421-4001618-1002.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1002.jpg saved to cache
2025-12-04 08:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52ca9fdd0>
2025-12-04 08:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_14.jpg HTTP/1.1" 201 0
2025-12-04 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3528421-4001618-1000.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1000.jpg saved to cache
2025-12-04 08:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e272d637-4ccf-5a3c-a8c2-64c996cd5690 with identifier: 2667513
2025-12-04 08:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e272d637-4ccf-5a3c-a8c2-64c996cd5690 with scrape type 2
2025-12-04 08:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e272d637-4ccf-5a3c-a8c2-64c996cd5690 with scrape type 2
2025-12-04 08:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e272d637-4ccf-5a3c-a8c2-64c996cd5690, identifier: 2667513
2025-12-04 08:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d02f576-2dd2-563d-9db3-0692a2501bcd with identifier: 2664010
2025-12-04 08:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d02f576-2dd2-563d-9db3-0692a2501bcd with scrape type 2
2025-12-04 08:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d02f576-2dd2-563d-9db3-0692a2501bcd with scrape type 2
2025-12-04 08:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3d02f576-2dd2-563d-9db3-0692a2501bcd, identifier: 2664010
2025-12-04 08:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e272d637-4ccf-5a3c-a8c2-64c996cd5690 with identifier: 2667513
2025-12-04 08:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e272d637-4ccf-5a3c-a8c2-64c996cd5690 with identifier: 2667513
2025-12-04 08:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e272d637-4ccf-5a3c-a8c2-64c996cd5690 with identifier: 2667513 to the API
2025-12-04 08:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/CITROEN/C4CACTUS?id=2667513&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232667513&indx=155>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002667513-01942186-003.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e272d637-4ccf-5a3c-a8c2-64c996cd5690',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YD66PCU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C4%20CACTUS?id=2667513',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'CITROEN',
 'model': 'C4 CACTUS',
 'odometer': 65251,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-13',
 'seller_name': 'Donalds Group',
 'title': 'CITROEN C4 CACTUS 1.2 PureTech Touch 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Touch 5dr',
 'year': 2016}
2025-12-04 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272667513%27 HTTP/1.1" 200 None
2025-12-04 08:04:10 [manheim.gb] INFO: Saving data for 2667513: {'auction_closing_time': 1764838800.0, 'created_time': 1764583779.318728, 'last_price_update_time': 1764835450.93758}
2025-12-04 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2667513') HTTP/1.1" 204 0
2025-12-04 08:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3d02f576-2dd2-563d-9db3-0692a2501bcd with identifier: 2664010
2025-12-04 08:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3d02f576-2dd2-563d-9db3-0692a2501bcd with identifier: 2664010
2025-12-04 08:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'available car', 'price_includes_vat': False, 'title': 'skoda fabia 1.2 tsi 105 elegance 5dr', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'fabia', 'transmission': 'manual', 'engine': '1.2l', 'fuel_type': 'petrol', 'odometer': 132783, 'odometer_reading_unit': 'mi', 'registration_date': '2012-05-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/fabia?id=2664010', 'location': 'washington', 'origin_country_code': 'gb', 'trim': '1.2 tsi 105 elegance 5dr', 'license_plate': 'ef12krz', 'year': 2012, 'listing': 'directbuy', 'c_o_2_emission_value': 124, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002664010-01984058-004.pdf', 'expiration_date': '2025-12-05t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '3d02f576-2dd2-563d-9db3-0692a2501bcd', 'current_year_diff': 13, 'age_in_months': 162, 'make_model': 'skoda fabia', 'sanitized_make': 'skoda', 'odometer_in_km': 213692}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 162,
     'auction_title': '',
     'c_o_2_emission_value': 124,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002664010-01984058-004.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 13,
     'engine': '1.2l',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'petrol',
     'id': '3d02f576-2dd2-563d-9db3-0692a2501bcd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ef12krz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/fabia?id=2664010',
     'listing': 'directbuy',
     'location': 'washington',
     'make': 'skoda',
     'make_model': 'skoda fabia',
     'model': 'fabia',
     'odometer': 132783,
     'odometer_in_km': 213692,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2012-05-31',
     'sanitized_make': 'skoda',
     'seller_name': 'available car',
     'title': 'skoda fabia 1.2 tsi 105 elegance 5dr',
     'transmission': 'manual',
     'trim': '1.2 tsi 105 elegance 5dr',
     'year': 2012}
2025-12-04 08:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 3d02f576-2dd2-563d-9db3-0692a2501bcd spider: manheim.gb
2025-12-04 08:04:11 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 3d02f576-2dd2-563d-9db3-0692a2501bcd due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'available car', 'price_includes_vat': False, 'title': 'skoda fabia 1.2 tsi 105 elegance 5dr', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'fabia', 'transmission': 'manual', 'engine': '1.2l', 'fuel_type': 'petrol', 'odometer': 132783, 'odometer_reading_unit': 'mi', 'registration_date': '2012-05-31', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/fabia?id=2664010', 'location': 'washington', 'origin_country_code': 'gb', 'trim': '1.2 tsi 105 elegance 5dr', 'license_plate': 'ef12krz', 'year': 2012, 'listing': 'directbuy', 'c_o_2_emission_value': 124, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002664010-01984058-004.pdf', 'expiration_date': '2025-12-05t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '3d02f576-2dd2-563d-9db3-0692a2501bcd', 'current_year_diff': 13, 'age_in_months': 162, 'make_model': 'skoda fabia', 'sanitized_make': 'skoda', 'odometer_in_km': 213692}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 162,
     'auction_title': '',
     'c_o_2_emission_value': 124,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002664010-01984058-004.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 13,
     'engine': '1.2l',
     'expiration_date': '2025-12-05t09:00:00z',
     'fuel_type': 'petrol',
     'id': '3d02f576-2dd2-563d-9db3-0692a2501bcd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'ef12krz',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/skoda/fabia?id=2664010',
     'listing': 'directbuy',
     'location': 'washington',
     'make': 'skoda',
     'make_model': 'skoda fabia',
     'model': 'fabia',
     'odometer': 132783,
     'odometer_in_km': 213692,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2012-05-31',
     'sanitized_make': 'skoda',
     'seller_name': 'available car',
     'title': 'skoda fabia 1.2 tsi 105 elegance 5dr',
     'transmission': 'manual',
     'trim': '1.2 tsi 105 elegance 5dr',
     'year': 2012}
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002664010-01984058-004.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3d02f576-2dd2-563d-9db3-0692a2501bcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EF12KRZ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SKODA/FABIA?id=2664010',
 'listing': 'directbuy',
 'location': 'Washington',
 'make': 'SKODA',
 'model': 'FABIA',
 'odometer': 132783,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-31',
 'seller_name': 'Available Car',
 'title': 'SKODA FABIA 1.2 TSI 105 Elegance 5dr',
 'transmission': 'manual',
 'trim': '1.2 TSI 105 Elegance 5dr',
 'year': 2012}
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272664010%27 HTTP/1.1" 200 None
2025-12-04 08:04:11 [manheim.gb] INFO: Saving data for 2664010: {'auction_closing_time': 1764925200.0, 'created_time': 1764583769.473579, 'last_price_update_time': 1764835451.180343}
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2664010') HTTP/1.1" 204 0
2025-12-04 08:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cc0b790>
2025-12-04 08:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_expert_report_file_b353c582-ecbd-4199-bcf9-ca277846e959.pdf HTTP/1.1" 201 0
2025-12-04 08:04:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb113377-2fab-5ec7-b02d-6df30f08e5d8, skipping ID generation
2025-12-04 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 20 photos for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_7.jpg not downloaded yet
2025-12-04 08:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_7.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_7.jpg not downloaded yet
2025-12-04 08:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2562472&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232562472&indx=142> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/4SERIES?id=2589156&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232589156&indx=144> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_6.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_6.jpg not downloaded yet
2025-12-04 08:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c341310>
2025-12-04 08:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_10.jpg HTTP/1.1" 201 0
2025-12-04 08:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_5.jpg saved to cache
2025-12-04 08:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c9cbe10>
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_11.jpg HTTP/1.1" 201 0
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_3.jpg saved to cache
2025-12-04 08:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cdf4390>
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_12.jpg HTTP/1.1" 201 0
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_4.jpg saved to cache
2025-12-04 08:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_1.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_1.jpg not downloaded yet
2025-12-04 08:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_5.jpg not downloaded yet
2025-12-04 08:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c527c10>
2025-12-04 08:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_9.jpg HTTP/1.1" 201 0
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_2.jpg saved to cache
2025-12-04 08:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c363d90>
2025-12-04 08:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_13.jpg HTTP/1.1" 201 0
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3528421-4001618-13.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-13.jpg saved to cache
2025-12-04 08:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40576e60-7714-51a3-b421-204c9ca6466d with identifier: 2562472
2025-12-04 08:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40576e60-7714-51a3-b421-204c9ca6466d with scrape type 2
2025-12-04 08:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40576e60-7714-51a3-b421-204c9ca6466d with scrape type 2
2025-12-04 08:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 40576e60-7714-51a3-b421-204c9ca6466d, identifier: 2562472
2025-12-04 08:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a02fa0fa-8faa-5884-b276-54e4303dc975 with identifier: 2589156
2025-12-04 08:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a02fa0fa-8faa-5884-b276-54e4303dc975 with scrape type 2
2025-12-04 08:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a02fa0fa-8faa-5884-b276-54e4303dc975 with scrape type 2
2025-12-04 08:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a02fa0fa-8faa-5884-b276-54e4303dc975, identifier: 2589156
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_4.jpg not downloaded yet
2025-12-04 08:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 40576e60-7714-51a3-b421-204c9ca6466d with identifier: 2562472
2025-12-04 08:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 40576e60-7714-51a3-b421-204c9ca6466d with identifier: 2562472
2025-12-04 08:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 40576e60-7714-51a3-b421-204c9ca6466d with identifier: 2562472 to the API
2025-12-04 08:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2562472&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232562472&indx=142>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002562472-01987183-001.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '40576e60-7714-51a3-b421-204c9ca6466d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FP19YXT',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FIESTA?id=2562472',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'FORD',
 'model': 'FIESTA',
 'odometer': 42472,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-01',
 'seller_name': 'Sytner',
 'title': 'FORD FIESTA 1.0 EcoBoost Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Zetec 5dr',
 'year': 2019}
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272562472%27 HTTP/1.1" 200 None
2025-12-04 08:04:14 [manheim.gb] INFO: Saving data for 2562472: {'auction_closing_time': 1765270800.0, 'created_time': 1764741856.488217, 'last_price_update_time': 1764835454.15768}
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2562472') HTTP/1.1" 204 0
2025-12-04 08:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a02fa0fa-8faa-5884-b276-54e4303dc975 with identifier: 2589156
2025-12-04 08:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a02fa0fa-8faa-5884-b276-54e4303dc975 with identifier: 2589156
2025-12-04 08:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: a02fa0fa-8faa-5884-b276-54e4303dc975 with identifier: 2589156 to the API
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27a02fa0fa-8faa-5884-b276-54e4303dc975%27 HTTP/1.1" 200 None
2025-12-04 08:04:14 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id a02fa0fa-8faa-5884-b276-54e4303dc975: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 08:04:13 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 08:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/BMW/4SERIES?id=2589156&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232589156&indx=144>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002589156-01972225-005.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a02fa0fa-8faa-5884-b276-54e4303dc975',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RF18YZO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/4%20SERIES?id=2589156',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'BMW',
 'model': '4 SERIES',
 'odometer': 74246,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-29',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'BMW 4 SERIES 420i M Sport 2dr Auto [Professional Media]',
 'transmission': 'automatic',
 'trim': '420i M Sport 2dr Auto [Professional Media]',
 'year': 2018}
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272589156%27 HTTP/1.1" 200 None
2025-12-04 08:04:14 [manheim.gb] INFO: Saving data for 2589156: {'auction_closing_time': 1765184400.0, 'created_time': 1764583790.501585, 'last_price_update_time': 1764835454.467879}
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2589156') HTTP/1.1" 204 0
2025-12-04 08:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_11.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_11.jpg not downloaded yet
2025-12-04 08:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_10.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_10.jpg not downloaded yet
2025-12-04 08:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c526ad0>
2025-12-04 08:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_8.jpg HTTP/1.1" 201 0
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_9.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_9.jpg saved to cache
2025-12-04 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cbb0450>
2025-12-04 08:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_3.jpg HTTP/1.1" 201 0
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_1.jpg saved to cache
2025-12-04 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cdc8950>
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_4.jpg HTTP/1.1" 201 0
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_5.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_5.jpg saved to cache
2025-12-04 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cd06b50>
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_5.jpg HTTP/1.1" 201 0
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_4.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_4.jpg saved to cache
2025-12-04 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52ccb6a90>
2025-12-04 08:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_6.jpg HTTP/1.1" 201 0
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_11.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_11.jpg saved to cache
2025-12-04 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52ca48c90>
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_0.jpg HTTP/1.1" 201 0
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_7.jpg saved to cache
2025-12-04 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_6.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_9.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_9.jpg not downloaded yet
2025-12-04 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=2528107&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232528107&indx=133> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_2.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_2.jpg not downloaded yet
2025-12-04 08:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_1.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cbf5590>
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_7.jpg HTTP/1.1" 201 0
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_10.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_10.jpg saved to cache
2025-12-04 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52ce16190>
2025-12-04 08:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_1.jpg HTTP/1.1" 201 0
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_7.jpg saved to cache
2025-12-04 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52ccaebd0>
2025-12-04 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_2.jpg HTTP/1.1" 201 0
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_6.jpg saved to cache
2025-12-04 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_7.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf)
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_5.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_5.jpg not downloaded yet
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_3.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_3.jpg not downloaded yet
2025-12-04 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_10.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_11.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_4.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_4.jpg not downloaded yet
2025-12-04 08:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c343d10>
2025-12-04 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_2.jpg HTTP/1.1" 201 0
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_6.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_6.jpg saved to cache
2025-12-04 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e302b2a1-cc53-52af-ac82-65ce87c63923 with identifier: 2528107
2025-12-04 08:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e302b2a1-cc53-52af-ac82-65ce87c63923 with scrape type 2
2025-12-04 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e302b2a1-cc53-52af-ac82-65ce87c63923 with scrape type 2
2025-12-04 08:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: e302b2a1-cc53-52af-ac82-65ce87c63923, identifier: 2528107
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52ccdeb50>
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_4.jpg HTTP/1.1" 201 0
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_5.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_5.jpg saved to cache
2025-12-04 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c4bbed0>
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_3.jpg HTTP/1.1" 201 0
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_1.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_1.jpg saved to cache
2025-12-04 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c340c10>
2025-12-04 08:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_5.jpg HTTP/1.1" 201 0
2025-12-04 08:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_4.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_4.jpg saved to cache
2025-12-04 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: e302b2a1-cc53-52af-ac82-65ce87c63923 with identifier: 2528107
2025-12-04 08:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: e302b2a1-cc53-52af-ac82-65ce87c63923 with identifier: 2528107
2025-12-04 08:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: e302b2a1-cc53-52af-ac82-65ce87c63923 with identifier: 2528107 to the API
2025-12-04 08:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=2528107&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232528107&indx=133>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002528107-01990507-001.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e302b2a1-cc53-52af-ac82-65ce87c63923',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LR67ZRE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/POLO?id=2528107',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'VOLKSWAGEN',
 'model': 'POLO',
 'odometer': 50631,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-29',
 'seller_name': 'Sytner',
 'title': 'VOLKSWAGEN POLO 1.2 TSI Match Edition 5dr',
 'transmission': 'manual',
 'trim': '1.2 TSI Match Edition 5dr',
 'year': 2017}
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272528107%27 HTTP/1.1" 200 None
2025-12-04 08:04:20 [manheim.gb] INFO: Saving data for 2528107: {'auction_closing_time': 1765270800.0, 'created_time': 1764741888.723336, 'last_price_update_time': 1764835460.146646}
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2528107') HTTP/1.1" 204 0
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3518224-4005196-13.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-13.jpg not downloaded yet
2025-12-04 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/CITROEN/C3AIRCROSS?id=2461241&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232461241&indx=130> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3518224-4005196-1000.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1000.jpg not downloaded yet
2025-12-04 08:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_9.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_5.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cdcb310>
2025-12-04 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_1.jpg HTTP/1.1" 201 0
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_7.jpg saved to cache
2025-12-04 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c4b9c10>
2025-12-04 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_0.jpg HTTP/1.1" 201 0
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252F1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_7.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_7.jpg saved to cache
2025-12-04 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cabc01c0-d6ee-5553-b97b-54efad114c13
2025-12-04 08:04:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cabc01c0-d6ee-5553-b97b-54efad114c13, skipping ID generation
2025-12-04 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cabc01c0-d6ee-5553-b97b-54efad114c13 from tracking dictionaries
2025-12-04 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cabc01c0-d6ee-5553-b97b-54efad114c13 sending to next pipeline
2025-12-04 08:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cabc01c0-d6ee-5553-b97b-54efad114c13, identifier: 3528421
2025-12-04 08:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cac3490>
2025-12-04 08:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_7.jpg HTTP/1.1" 201 0
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_10.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_10.jpg saved to cache
2025-12-04 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cdd6c50>
2025-12-04 08:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_6.jpg HTTP/1.1" 201 0
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_11.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_11.jpg saved to cache
2025-12-04 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_2.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_3.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:21 [scrapy.extensions.logstats] INFO: Crawled 62 pages (at 25 pages/min), scraped 19 items (at 9 items/min)
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3518224-4005196-1001.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1001.jpg not downloaded yet
2025-12-04 08:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cabc01c0-d6ee-5553-b97b-54efad114c13 with identifier: 3528421
2025-12-04 08:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cabc01c0-d6ee-5553-b97b-54efad114c13 with identifier: 3528421
2025-12-04 08:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: cabc01c0-d6ee-5553-b97b-54efad114c13 with identifier: 3528421 to the API
2025-12-04 08:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_expert_report_file_7460bb9f-f12c-4bab-8610-5dcfbeff7987.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003528421-01980774-002.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cabc01c0-d6ee-5553-b97b-54efad114c13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FJ21OUD',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FIAT/500?id=3528421',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'FIAT',
 'model': '500',
 'odometer': 28370,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 28,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286349,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 286349,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_7.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 236896,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 180682,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245577,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239182,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 239198,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_11.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231593,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_10.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 245906,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_9.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 231384,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208030,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208588,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 225002,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/1622d7de-586e-45b0-a3c0-9074812b7dd2_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 366382,
             'Height': 937,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-13.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 336827,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 215787,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 289425,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 405781,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 264798,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cabc01c0-d6ee-5553-b97b-54efad114c13/cabc01c0-d6ee-5553-b97b-54efad114c13_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 208009,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3528421-4001618-1005.jpg',
             'Width': 749}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-30',
 'seller_name': 'Leasys',
 'title': 'FIAT 500 1.0 Mild Hybrid Lounge 3dr',
 'transmission': 'manual',
 'trim': '1.0 Mild Hybrid Lounge 3dr',
 'year': 2021}
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273528421%27 HTTP/1.1" 200 None
2025-12-04 08:04:22 [manheim.gb] INFO: Saving data for 3528421: {'created_time': 1764835462.304961, 'last_price_update_time': 1764835462.304972, 'auction_closing_time': 1765270800.0}
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3528421') HTTP/1.1" 204 0
2025-12-04 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIETTA?id=2542025&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232542025&indx=135> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3518224-4005196-1002.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1002.jpg not downloaded yet
2025-12-04 08:04:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0 with identifier: 2461241
2025-12-04 08:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0 with scrape type 2
2025-12-04 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0 with scrape type 2
2025-12-04 08:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0, identifier: 2461241
2025-12-04 08:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cd04fd0>
2025-12-04 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_8.jpg HTTP/1.1" 201 0
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_9.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_9.jpg saved to cache
2025-12-04 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c4e0450>
2025-12-04 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 08:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_10.jpg HTTP/1.1" 201 0
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_5.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_5.jpg saved to cache
2025-12-04 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/BMW/5SERIES?id=2458076&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232458076&indx=129> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0 with identifier: 2461241
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=ORANGE HTTP/1.1" 200 None
2025-12-04 08:04:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 08:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0 with identifier: 2461241
2025-12-04 08:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151530 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151530
2025-12-04 08:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0 spider: manheim.gb
2025-12-04 08:04:23 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0 due to rule: high_mileage_for_country.json, error: 151530 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151530
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002461241-01970176-007.pdf',
 'color': 'ORANGE',
 'currency': 'GBP',
 'engine': '1.2L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5522c61e-93a4-5fcf-941c-c1c0a1e2e7e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NGZ9074',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/CITROEN/C3%20AIRCROSS?id=2461241',
 'listing': 'auction',
 'location': 'Leeds',
 'make': 'CITROEN',
 'model': 'C3 AIRCROSS',
 'odometer': 94157,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-19',
 'seller_name': 'Direct Company',
 'title': 'CITROEN C3 AIRCROSS 1.2 PureTech Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Flair 5dr',
 'year': 2019}
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272461241%27 HTTP/1.1" 200 None
2025-12-04 08:04:23 [manheim.gb] INFO: Saving data for 2461241: {'auction_closing_time': 1764838800.0, 'created_time': 1764583885.740944, 'last_price_update_time': 1764835463.463838}
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2461241') HTTP/1.1" 204 0
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3518224-4005196-1003.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1003.jpg not downloaded yet
2025-12-04 08:04:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cac1b10>
2025-12-04 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_9.jpg HTTP/1.1" 201 0
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_2.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_2.jpg saved to cache
2025-12-04 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c4d5a50>
2025-12-04 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_11.jpg HTTP/1.1" 201 0
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_3.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_3.jpg saved to cache
2025-12-04 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 11 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_4.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-13.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1000.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3518224-4005196-1004.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1004.jpg not downloaded yet
2025-12-04 08:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1001.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0df5f05-813f-55bb-8394-48a9b83bddd6 with identifier: 2542025
2025-12-04 08:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0df5f05-813f-55bb-8394-48a9b83bddd6 with scrape type 2
2025-12-04 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0df5f05-813f-55bb-8394-48a9b83bddd6 with scrape type 2
2025-12-04 08:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: d0df5f05-813f-55bb-8394-48a9b83bddd6, identifier: 2542025
2025-12-04 08:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 853ebe17-c341-5988-b967-28d3a04dc876 with identifier: 2458076
2025-12-04 08:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 853ebe17-c341-5988-b967-28d3a04dc876 with scrape type 2
2025-12-04 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 853ebe17-c341-5988-b967-28d3a04dc876 with scrape type 2
2025-12-04 08:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 853ebe17-c341-5988-b967-28d3a04dc876, identifier: 2458076
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3518224-4005196-1005.jpg%27 HTTP/1.1" 200 None
2025-12-04 08:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1005.jpg not downloaded yet
2025-12-04 08:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: d0df5f05-813f-55bb-8394-48a9b83bddd6 with identifier: 2542025
2025-12-04 08:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: d0df5f05-813f-55bb-8394-48a9b83bddd6 with identifier: 2542025
2025-12-04 08:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 148149 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    148149
2025-12-04 08:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: d0df5f05-813f-55bb-8394-48a9b83bddd6 spider: manheim.gb
2025-12-04 08:04:24 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: d0df5f05-813f-55bb-8394-48a9b83bddd6 due to rule: high_mileage_for_make.json, error: 148149 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    148149
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002542025-01984219-002.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd0df5f05-813f-55bb-8394-48a9b83bddd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ND65WHE',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/ALFA%20ROMEO/GIULIETTA?id=2542025',
 'listing': 'directbuy',
 'location': 'Leeds',
 'make': 'ALFA ROMEO',
 'model': 'GIULIETTA',
 'odometer': 92056,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-29',
 'seller_name': 'Available Car',
 'title': 'ALFA ROMEO GIULIETTA 1.4 TB MultiAir Exclusive 5dr',
 'transmission': 'manual',
 'trim': '1.4 TB MultiAir Exclusive 5dr',
 'year': 2016}
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272542025%27 HTTP/1.1" 200 None
2025-12-04 08:04:24 [manheim.gb] INFO: Saving data for 2542025: {'auction_closing_time': 1765184400.0, 'created_time': 1764583852.616928, 'last_price_update_time': 1764835464.76371}
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2542025') HTTP/1.1" 204 0
2025-12-04 08:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 853ebe17-c341-5988-b967-28d3a04dc876 with identifier: 2458076
2025-12-04 08:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 853ebe17-c341-5988-b967-28d3a04dc876 with identifier: 2458076
2025-12-04 08:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 853ebe17-c341-5988-b967-28d3a04dc876 with identifier: 2458076 to the API
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%27853ebe17-c341-5988-b967-28d3a04dc876%27 HTTP/1.1" 200 None
2025-12-04 08:04:25 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 853ebe17-c341-5988-b967-28d3a04dc876: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 08:04:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 08:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/BMW/5SERIES?id=2458076&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232458076&indx=129>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002458076-01982934-002.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '853ebe17-c341-5988-b967-28d3a04dc876',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GY18TYS',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/BMW/5%20SERIES?id=2458076',
 'listing': 'directbuy',
 'location': 'Leeds',
 'make': 'BMW',
 'model': '5 SERIES',
 'odometer': 48514,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-10',
 'seller_name': 'Lookers',
 'title': 'BMW 5 SERIES 520i M Sport 4dr Auto',
 'transmission': 'automatic',
 'trim': '520i M Sport 4dr Auto',
 'year': 2018}
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272458076%27 HTTP/1.1" 200 None
2025-12-04 08:04:25 [manheim.gb] INFO: Saving data for 2458076: {'auction_closing_time': 1765184400.0, 'created_time': 1764583416.795653, 'last_price_update_time': 1764835465.083702}
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2458076') HTTP/1.1" 204 0
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c9a7790>
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_12.jpg HTTP/1.1" 201 0
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Fe5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_4.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_4.jpg saved to cache
2025-12-04 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 12 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c4e1ad0>
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_13.jpg HTTP/1.1" 201 0
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3518224-4005196-13.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-13.jpg saved to cache
2025-12-04 08:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 13 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52ce68f50>
2025-12-04 08:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 08:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_14.jpg HTTP/1.1" 201 0
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3518224-4005196-1000.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1000.jpg saved to cache
2025-12-04 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 14 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52cab5f50>
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_15.jpg HTTP/1.1" 201 0
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3518224-4005196-1001.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1001.jpg saved to cache
2025-12-04 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 15 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1002.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1003.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1004.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c9dafd0>
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_16.jpg HTTP/1.1" 201 0
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3518224-4005196-1002.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1002.jpg saved to cache
2025-12-04 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 16 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c4d1ad0>
2025-12-04 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 08:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_17.jpg HTTP/1.1" 201 0
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3518224-4005196-1003.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1003.jpg saved to cache
2025-12-04 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 17 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c9b7250>
2025-12-04 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_18.jpg HTTP/1.1" 201 0
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3518224-4005196-1004.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1004.jpg saved to cache
2025-12-04 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 18 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1005.jpg> (referer: http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf)
2025-12-04 08:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 08:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fb52c502710>
2025-12-04 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_19.jpg HTTP/1.1" 201 0
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='manheim.gb',RowKey='http%3A%252F%252Fimages.manheim.co.uk%252Fimages%252Funits%252Fzoom%252Finsp-0001-3518224-4005196-1005.jpg') HTTP/1.1" 204 0
2025-12-04 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1005.jpg saved to cache
2025-12-04 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 19 for item bb113377-2fab-5ec7-b02d-6df30f08e5d8
2025-12-04 08:04:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb113377-2fab-5ec7-b02d-6df30f08e5d8, skipping ID generation
2025-12-04 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bb113377-2fab-5ec7-b02d-6df30f08e5d8 from tracking dictionaries
2025-12-04 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb113377-2fab-5ec7-b02d-6df30f08e5d8 sending to next pipeline
2025-12-04 08:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: bb113377-2fab-5ec7-b02d-6df30f08e5d8, identifier: 3518224
2025-12-04 08:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: bb113377-2fab-5ec7-b02d-6df30f08e5d8 with identifier: 3518224
2025-12-04 08:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: bb113377-2fab-5ec7-b02d-6df30f08e5d8 with identifier: 3518224
2025-12-04 08:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: bb113377-2fab-5ec7-b02d-6df30f08e5d8 with identifier: 3518224 to the API
2025-12-04 08:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1005.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_expert_report_file_b353c582-ecbd-4199-bcf9-ca277846e959.pdf',
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0003518224-01986550-004.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'bb113377-2fab-5ec7-b02d-6df30f08e5d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'AY20OVV',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/JUKE?id=3518224',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'NISSAN',
 'model': 'JUKE',
 'odometer': 71976,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 34,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201909,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201909,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_7.jpg',
             'Width': 1499},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 253298,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_6.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 210771,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_1.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 211370,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_5.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200244,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_4.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 202203,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_11.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 194090,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_10.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 200152,
             'Height': 999,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_9.jpg',
             'Width': 1500},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 267951,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_2.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 201759,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_5.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_11.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 206460,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_3.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_12.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213262,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/e5357d89-238f-4e41-9d72-c4a21c0e3b6c_ext_4.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_13.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 282040,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-13.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_14.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 181459,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1000.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_15.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 183381,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1001.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_16.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 263687,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1002.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_17.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 276929,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1003.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_18.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 312602,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1004.jpg',
             'Width': 1333},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb113377-2fab-5ec7-b02d-6df30f08e5d8/bb113377-2fab-5ec7-b02d-6df30f08e5d8_image_19.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 213636,
             'Height': 1000,
             'OriginUrl': 'http://images.manheim.co.uk/images/units/zoom/insp-0001-3518224-4005196-1005.jpg',
             'Width': 1333}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-23',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'NISSAN JUKE 1.0 DiG-T N-Connecta 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.0 DiG-T N-Connecta 5dr DCT',
 'year': 2020}
2025-12-04 08:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273518224%27 HTTP/1.1" 200 None
2025-12-04 08:04:29 [manheim.gb] INFO: Saving data for 3518224: {'created_time': 1764835469.190706, 'last_price_update_time': 1764835469.190724, 'auction_closing_time': 1765270800.0}
2025-12-04 08:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3518224') HTTP/1.1" 204 0
2025-12-04 08:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=2443996&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232443996&indx=126> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:04:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3750b417-7b9c-51e9-87ea-df95ec29d7ad with identifier: 2443996
2025-12-04 08:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad with scrape type 2
2025-12-04 08:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3750b417-7b9c-51e9-87ea-df95ec29d7ad with scrape type 2
2025-12-04 08:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 3750b417-7b9c-51e9-87ea-df95ec29d7ad, identifier: 2443996
2025-12-04 08:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 3750b417-7b9c-51e9-87ea-df95ec29d7ad with identifier: 2443996
2025-12-04 08:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 3750b417-7b9c-51e9-87ea-df95ec29d7ad with identifier: 2443996
2025-12-04 08:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
2025-12-04 08:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 3750b417-7b9c-51e9-87ea-df95ec29d7ad spider: manheim.gb
2025-12-04 08:04:41 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 3750b417-7b9c-51e9-87ea-df95ec29d7ad due to rule: registration_date_old.json, error: 11 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    11
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002443996-01989868-001.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-10T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '3750b417-7b9c-51e9-87ea-df95ec29d7ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SL14FMU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/2008?id=2443996',
 'listing': 'auction',
 'location': 'Birmingham',
 'make': 'PEUGEOT',
 'model': '2008',
 'odometer': 81623,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-20',
 'seller_name': 'Hilton Garage Ltd',
 'title': 'PEUGEOT 2008 1.6 e-HDi Allure 5dr',
 'transmission': 'manual',
 'trim': '1.6 e-HDi Allure 5dr',
 'year': 2014}
2025-12-04 08:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272443996%27 HTTP/1.1" 200 None
2025-12-04 08:04:41 [manheim.gb] INFO: Saving data for 2443996: {'auction_closing_time': 1765357200.0, 'created_time': 1764741881.329237, 'last_price_update_time': 1764835481.053695}
2025-12-04 08:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2443996') HTTP/1.1" 204 0
2025-12-04 08:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2437613&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232437613&indx=124> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:04:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4 with identifier: 2437613
2025-12-04 08:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4 with scrape type 2
2025-12-04 08:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4 with scrape type 2
2025-12-04 08:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4, identifier: 2437613
2025-12-04 08:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4 with identifier: 2437613
2025-12-04 08:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4 with identifier: 2437613
2025-12-04 08:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4 with identifier: 2437613 to the API
2025-12-04 08:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2437613&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232437613&indx=124>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002437613-01987146-008.pdf',
 'color': 'SILVER',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '00ab3a24-8ec7-5aa6-b9a1-789576a1c9a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WM19RVJ',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2437613',
 'listing': 'auction',
 'location': 'Manchester',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 48051,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-07',
 'seller_name': 'Santander Consumer',
 'title': 'FORD FOCUS 1.0 EcoBoost 125 ST-Line 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.0 EcoBoost 125 ST-Line 5dr Auto',
 'year': 2019}
2025-12-04 08:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272437613%27 HTTP/1.1" 200 None
2025-12-04 08:04:42 [manheim.gb] INFO: Saving data for 2437613: {'auction_closing_time': 1764838800.0, 'created_time': 1764583890.435912, 'last_price_update_time': 1764835482.25265}
2025-12-04 08:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2437613') HTTP/1.1" 204 0
2025-12-04 08:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/RENAULT/CLIO?id=2374569&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232374569&indx=118> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d855954-126f-5aff-95e9-38f24feb23e8 with identifier: 2374569
2025-12-04 08:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d855954-126f-5aff-95e9-38f24feb23e8 with scrape type 2
2025-12-04 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d855954-126f-5aff-95e9-38f24feb23e8 with scrape type 2
2025-12-04 08:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 0d855954-126f-5aff-95e9-38f24feb23e8, identifier: 2374569
2025-12-04 08:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 0d855954-126f-5aff-95e9-38f24feb23e8 with identifier: 2374569
2025-12-04 08:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 0d855954-126f-5aff-95e9-38f24feb23e8 with identifier: 2374569
2025-12-04 08:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 0d855954-126f-5aff-95e9-38f24feb23e8 with identifier: 2374569 to the API
2025-12-04 08:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 08:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%270d855954-126f-5aff-95e9-38f24feb23e8%27 HTTP/1.1" 200 None
2025-12-04 08:04:42 [crawlers.pipelines.post_to_api] ERROR: manheim.gb, item_id 0d855954-126f-5aff-95e9-38f24feb23e8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 08:04:42 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 08:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/RENAULT/CLIO?id=2374569&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232374569&indx=118>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002374569-01987131-003.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '0.9L',
 'expiration_date': '2025-12-05T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0d855954-126f-5aff-95e9-38f24feb23e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HT19AUF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/CLIO?id=2374569',
 'listing': 'directbuy',
 'location': 'Washington',
 'make': 'RENAULT',
 'model': 'CLIO',
 'odometer': 69936,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-28',
 'seller_name': 'S G Petch',
 'title': 'RENAULT CLIO 0.9 TCE 90 GT Line 5dr',
 'transmission': 'manual',
 'trim': '0.9 TCE 90 GT Line 5dr',
 'year': 2019}
2025-12-04 08:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272374569%27 HTTP/1.1" 200 None
2025-12-04 08:04:42 [manheim.gb] INFO: Saving data for 2374569: {'auction_closing_time': 1764925200.0, 'created_time': 1764583442.707808, 'last_price_update_time': 1764835482.916603}
2025-12-04 08:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2374569') HTTP/1.1" 204 0
2025-12-04 08:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/LEAF?id=2354571&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232354571&indx=115> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:04:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 08:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5afc30df-5017-5f5a-ac07-6e742dbdcbdd with identifier: 2354571
2025-12-04 08:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5afc30df-5017-5f5a-ac07-6e742dbdcbdd with scrape type 2
2025-12-04 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5afc30df-5017-5f5a-ac07-6e742dbdcbdd with scrape type 2
2025-12-04 08:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 5afc30df-5017-5f5a-ac07-6e742dbdcbdd, identifier: 2354571
2025-12-04 08:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 5afc30df-5017-5f5a-ac07-6e742dbdcbdd with identifier: 2354571
2025-12-04 08:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 5afc30df-5017-5f5a-ac07-6e742dbdcbdd with identifier: 2354571
2025-12-04 08:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'mobilize financial services', 'price_includes_vat': False, 'title': 'nissan leaf 80kw tekna 30kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 45317, 'odometer_reading_unit': 'mi', 'registration_date': '2017-03-25', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2354571', 'location': 'leeds - in transit', 'origin_country_code': 'gb', 'trim': '80kw tekna 30kwh 5dr auto', 'license_plate': 'gu17vjo', 'year': 2017, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002354571-01988705-001.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '5afc30df-5017-5f5a-ac07-6e742dbdcbdd', 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'nissan leaf', 'sanitized_make': 'nissan', 'odometer_in_km': 72930} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002354571-01988705-001.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 8,
     'engine': '0.0l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'electric',
     'id': '5afc30df-5017-5f5a-ac07-6e742dbdcbdd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'gu17vjo',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2354571',
     'listing': 'auction',
     'location': 'leeds - in transit',
     'make': 'nissan',
     'make_model': 'nissan leaf',
     'model': 'leaf',
     'odometer': 45317,
     'odometer_in_km': 72930,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-03-25',
     'sanitized_make': 'nissan',
     'seller_name': 'mobilize financial services',
     'title': 'nissan leaf 80kw tekna 30kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '80kw tekna 30kwh 5dr auto',
     'year': 2017}
2025-12-04 08:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 5afc30df-5017-5f5a-ac07-6e742dbdcbdd spider: manheim.gb
2025-12-04 08:04:46 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 5afc30df-5017-5f5a-ac07-6e742dbdcbdd due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'mobilize financial services', 'price_includes_vat': False, 'title': 'nissan leaf 80kw tekna 30kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf', 'transmission': 'automatic', 'engine': '0.0l', 'fuel_type': 'electric', 'odometer': 45317, 'odometer_reading_unit': 'mi', 'registration_date': '2017-03-25', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2354571', 'location': 'leeds - in transit', 'origin_country_code': 'gb', 'trim': '80kw tekna 30kwh 5dr auto', 'license_plate': 'gu17vjo', 'year': 2017, 'listing': 'auction', 'c_o_2_emission_value': 0, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002354571-01988705-001.pdf', 'expiration_date': '2025-12-08t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': '5afc30df-5017-5f5a-ac07-6e742dbdcbdd', 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'nissan leaf', 'sanitized_make': 'nissan', 'odometer_in_km': 72930} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 0,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002354571-01988705-001.pdf',
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 8,
     'engine': '0.0l',
     'expiration_date': '2025-12-08t09:00:00z',
     'fuel_type': 'electric',
     'id': '5afc30df-5017-5f5a-ac07-6e742dbdcbdd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'gu17vjo',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/nissan/leaf?id=2354571',
     'listing': 'auction',
     'location': 'leeds - in transit',
     'make': 'nissan',
     'make_model': 'nissan leaf',
     'model': 'leaf',
     'odometer': 45317,
     'odometer_in_km': 72930,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-03-25',
     'sanitized_make': 'nissan',
     'seller_name': 'mobilize financial services',
     'title': 'nissan leaf 80kw tekna 30kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '80kw tekna 30kwh 5dr auto',
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 0,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002354571-01988705-001.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '0.0L',
 'expiration_date': '2025-12-08T09:00:00Z',
 'fuel_type': 'Electric',
 'id': '5afc30df-5017-5f5a-ac07-6e742dbdcbdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GU17VJO',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/LEAF?id=2354571',
 'listing': 'auction',
 'location': 'Leeds - In Transit',
 'make': 'NISSAN',
 'model': 'LEAF',
 'odometer': 45317,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-25',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN LEAF 80kW Tekna 30kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '80kW Tekna 30kWh 5dr Auto',
 'year': 2017}
2025-12-04 08:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272354571%27 HTTP/1.1" 200 None
2025-12-04 08:04:46 [manheim.gb] INFO: Saving data for 2354571: {'auction_closing_time': 1765184400.0, 'created_time': 1764583482.599866, 'last_price_update_time': 1764835486.985581}
2025-12-04 08:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2354571') HTTP/1.1" 204 0
2025-12-04 08:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2359941&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232359941&indx=116> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:04:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efcb4fd5-559b-53e5-9553-625cad8ca741 with identifier: 2359941
2025-12-04 08:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efcb4fd5-559b-53e5-9553-625cad8ca741 with scrape type 2
2025-12-04 08:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efcb4fd5-559b-53e5-9553-625cad8ca741 with scrape type 2
2025-12-04 08:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: efcb4fd5-559b-53e5-9553-625cad8ca741, identifier: 2359941
2025-12-04 08:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: efcb4fd5-559b-53e5-9553-625cad8ca741 with identifier: 2359941
2025-12-04 08:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: efcb4fd5-559b-53e5-9553-625cad8ca741 with identifier: 2359941
2025-12-04 08:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'volkswagen golf 1.6 tdi 105 match 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'golf', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 171692, 'odometer_reading_unit': 'mi', 'registration_date': '2010-12-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/golf?id=2359941', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '1.6 tdi 105 match 5dr', 'license_plate': 'cy60gcu', 'year': 2010, 'listing': 'auction', 'c_o_2_emission_value': 119, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002359941-01984697-004.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'efcb4fd5-559b-53e5-9553-625cad8ca741', 'current_year_diff': 15, 'age_in_months': 179, 'make_model': 'volkswagen golf', 'sanitized_make': 'volkswagen', 'odometer_in_km': 276310}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 179,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002359941-01984697-004.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 15,
     'engine': '1.6l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'efcb4fd5-559b-53e5-9553-625cad8ca741',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'cy60gcu',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/golf?id=2359941',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'volkswagen',
     'make_model': 'volkswagen golf',
     'model': 'golf',
     'odometer': 171692,
     'odometer_in_km': 276310,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2010-12-30',
     'sanitized_make': 'volkswagen',
     'seller_name': None,
     'title': 'volkswagen golf 1.6 tdi 105 match 5dr',
     'transmission': 'manual',
     'trim': '1.6 tdi 105 match 5dr',
     'year': 2010}
2025-12-04 08:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: efcb4fd5-559b-53e5-9553-625cad8ca741 spider: manheim.gb
2025-12-04 08:04:49 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: efcb4fd5-559b-53e5-9553-625cad8ca741 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': None, 'price_includes_vat': False, 'title': 'volkswagen golf 1.6 tdi 105 match 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'golf', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 171692, 'odometer_reading_unit': 'mi', 'registration_date': '2010-12-30', 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/golf?id=2359941', 'location': 'bristol', 'origin_country_code': 'gb', 'trim': '1.6 tdi 105 match 5dr', 'license_plate': 'cy60gcu', 'year': 2010, 'listing': 'auction', 'c_o_2_emission_value': 119, 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002359941-01984697-004.pdf', 'expiration_date': '2025-12-04t09:00:00z', 'is_vat_deductible': False, 'is_vat_included': False, 'id': 'efcb4fd5-559b-53e5-9553-625cad8ca741', 'current_year_diff': 15, 'age_in_months': 179, 'make_model': 'volkswagen golf', 'sanitized_make': 'volkswagen', 'odometer_in_km': 276310}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 179,
     'auction_title': '',
     'c_o_2_emission_value': 119,
     'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/mol-0002359941-01984697-004.pdf',
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 15,
     'engine': '1.6l',
     'expiration_date': '2025-12-04t09:00:00z',
     'fuel_type': 'diesel',
     'id': 'efcb4fd5-559b-53e5-9553-625cad8ca741',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': False,
     'license_plate': 'cy60gcu',
     'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/volkswagen/golf?id=2359941',
     'listing': 'auction',
     'location': 'bristol',
     'make': 'volkswagen',
     'make_model': 'volkswagen golf',
     'model': 'golf',
     'odometer': 171692,
     'odometer_in_km': 276310,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2010-12-30',
     'sanitized_make': 'volkswagen',
     'seller_name': None,
     'title': 'volkswagen golf 1.6 tdi 105 match 5dr',
     'transmission': 'manual',
     'trim': '1.6 tdi 105 match 5dr',
     'year': 2010}
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002359941-01984697-004.pdf',
 'color': 'BLACK',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'efcb4fd5-559b-53e5-9553-625cad8ca741',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'CY60GCU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/GOLF?id=2359941',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF',
 'odometer': 171692,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-30',
 'seller_name': None,
 'title': 'VOLKSWAGEN GOLF 1.6 TDi 105 Match 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDi 105 Match 5dr',
 'year': 2010}
2025-12-04 08:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272359941%27 HTTP/1.1" 200 None
2025-12-04 08:04:49 [manheim.gb] INFO: Saving data for 2359941: {'auction_closing_time': 1764838800.0, 'created_time': 1764583915.833332, 'last_price_update_time': 1764835489.11111}
2025-12-04 08:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2359941') HTTP/1.1" 204 0
2025-12-04 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERYSPORT?id=2326281&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232326281&indx=112> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0b7b334-dc59-5030-a2b3-8abc203b93af with identifier: 2326281
2025-12-04 08:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0b7b334-dc59-5030-a2b3-8abc203b93af with scrape type 2
2025-12-04 08:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0b7b334-dc59-5030-a2b3-8abc203b93af with scrape type 2
2025-12-04 08:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: b0b7b334-dc59-5030-a2b3-8abc203b93af, identifier: 2326281
2025-12-04 08:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: b0b7b334-dc59-5030-a2b3-8abc203b93af with identifier: 2326281
2025-12-04 08:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: b0b7b334-dc59-5030-a2b3-8abc203b93af with identifier: 2326281
2025-12-04 08:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: b0b7b334-dc59-5030-a2b3-8abc203b93af with identifier: 2326281 to the API
2025-12-04 08:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERYSPORT?id=2326281&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232326281&indx=112>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002326281-01987261-002.pdf',
 'color': 'GREY',
 'currency': 'GBP',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b0b7b334-dc59-5030-a2b3-8abc203b93af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'BT66XLM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/LAND%20ROVER/DISCOVERY%20SPORT?id=2326281',
 'listing': 'auction',
 'location': 'Northampton',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT',
 'odometer': 73785,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-13',
 'seller_name': 'Vindis Group',
 'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE Black 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 180 HSE Black 5dr Auto',
 'year': 2017}
2025-12-04 08:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272326281%27 HTTP/1.1" 200 None
2025-12-04 08:04:58 [manheim.gb] INFO: Saving data for 2326281: {'auction_closing_time': 1764838800.0, 'created_time': 1764741930.734388, 'last_price_update_time': 1764835498.217915}
2025-12-04 08:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2326281') HTTP/1.1" 204 0
2025-12-04 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/SEAT/LEON?id=2286249&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232286249&indx=106> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf783f48-bd5e-5f09-82ee-022051d55284 with identifier: 2286249
2025-12-04 08:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf783f48-bd5e-5f09-82ee-022051d55284 with scrape type 2
2025-12-04 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf783f48-bd5e-5f09-82ee-022051d55284 with scrape type 2
2025-12-04 08:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: cf783f48-bd5e-5f09-82ee-022051d55284, identifier: 2286249
2025-12-04 08:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: cf783f48-bd5e-5f09-82ee-022051d55284 with identifier: 2286249
2025-12-04 08:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: cf783f48-bd5e-5f09-82ee-022051d55284 with identifier: 2286249
2025-12-04 08:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: cf783f48-bd5e-5f09-82ee-022051d55284 with identifier: 2286249 to the API
2025-12-04 08:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/SEAT/LEON?id=2286249&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232286249&indx=106>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002286249-01972433-004.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.4L',
 'expiration_date': '2025-12-09T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cf783f48-bd5e-5f09-82ee-022051d55284',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DA17HYM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/SEAT/LEON?id=2286249',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'SEAT',
 'model': 'LEON',
 'odometer': 84751,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-10',
 'seller_name': 'Novuna Vehicle Solutions',
 'title': 'SEAT LEON 1.4 TSI 125 FR Technology 5dr',
 'transmission': 'manual',
 'trim': '1.4 TSI 125 FR Technology 5dr',
 'year': 2017}
2025-12-04 08:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272286249%27 HTTP/1.1" 200 None
2025-12-04 08:05:03 [manheim.gb] INFO: Saving data for 2286249: {'auction_closing_time': 1765270800.0, 'created_time': 1764741928.072219, 'last_price_update_time': 1764835503.099168}
2025-12-04 08:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2286249') HTTP/1.1" 204 0
2025-12-04 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/PASSAT?id=2292927&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232292927&indx=108> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb with identifier: 2292927
2025-12-04 08:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb with scrape type 2
2025-12-04 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb with scrape type 2
2025-12-04 08:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb, identifier: 2292927
2025-12-04 08:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb with identifier: 2292927
2025-12-04 08:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb with identifier: 2292927
2025-12-04 08:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 173356 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173356
2025-12-04 08:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb spider: manheim.gb
2025-12-04 08:05:04 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 57ef5ea6-afe6-50b8-95a1-f7f2c46852cb due to rule: high_mileage_for_country.json, error: 173356 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    173356
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002292927-01960245-007.pdf',
 'color': 'WHITE',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '57ef5ea6-afe6-50b8-95a1-f7f2c46852cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SL15LZM',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/VOLKSWAGEN/PASSAT?id=2292927',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT',
 'odometer': 107719,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-27',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'VOLKSWAGEN PASSAT 1.6 TDI SE Business 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDI SE Business 5dr',
 'year': 2015}
2025-12-04 08:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272292927%27 HTTP/1.1" 200 None
2025-12-04 08:05:04 [manheim.gb] INFO: Saving data for 2292927: {'auction_closing_time': 1764838800.0, 'created_time': 1764583868.58709, 'last_price_update_time': 1764835504.31091}
2025-12-04 08:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2292927') HTTP/1.1" 204 0
2025-12-04 08:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2262431&returnUrl=%2Fsearch%3FPage%3D2%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%232262431&indx=101> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 404cbca9-16e9-5f50-bd05-e7fab382a3d0 with identifier: 2262431
2025-12-04 08:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0 with scrape type 2
2025-12-04 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 404cbca9-16e9-5f50-bd05-e7fab382a3d0 with scrape type 2
2025-12-04 08:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 404cbca9-16e9-5f50-bd05-e7fab382a3d0, identifier: 2262431
2025-12-04 08:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 404cbca9-16e9-5f50-bd05-e7fab382a3d0 with identifier: 2262431
2025-12-04 08:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 404cbca9-16e9-5f50-bd05-e7fab382a3d0 with identifier: 2262431
2025-12-04 08:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-04 08:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 404cbca9-16e9-5f50-bd05-e7fab382a3d0 spider: manheim.gb
2025-12-04 08:05:07 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: 404cbca9-16e9-5f50-bd05-e7fab382a3d0 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0002262431-01985060-004.pdf',
 'color': 'RED',
 'currency': 'GBP',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': '404cbca9-16e9-5f50-bd05-e7fab382a3d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EN64OFA',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/FORD/FOCUS?id=2262431',
 'listing': 'auction',
 'location': 'Bristol',
 'make': 'FORD',
 'model': 'FOCUS',
 'odometer': 81392,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-23',
 'seller_name': 'Mon Motors',
 'title': 'FORD FOCUS 1.6 TDCi 115 Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDCi 115 Titanium 5dr',
 'year': 2015}
2025-12-04 08:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%272262431%27 HTTP/1.1" 200 None
2025-12-04 08:05:07 [manheim.gb] INFO: Saving data for 2262431: {'auction_closing_time': 1764838800.0, 'created_time': 1764741929.07245, 'last_price_update_time': 1764835507.781288}
2025-12-04 08:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='2262431') HTTP/1.1" 204 0
2025-12-04 08:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=1815539&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231815539&indx=63> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a45157ed-0b57-550e-b71f-216ca1e78b3c with identifier: 1815539
2025-12-04 08:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a45157ed-0b57-550e-b71f-216ca1e78b3c with scrape type 2
2025-12-04 08:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a45157ed-0b57-550e-b71f-216ca1e78b3c with scrape type 2
2025-12-04 08:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: a45157ed-0b57-550e-b71f-216ca1e78b3c, identifier: 1815539
2025-12-04 08:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: a45157ed-0b57-550e-b71f-216ca1e78b3c with identifier: 1815539
2025-12-04 08:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: a45157ed-0b57-550e-b71f-216ca1e78b3c with identifier: 1815539
2025-12-04 08:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: a45157ed-0b57-550e-b71f-216ca1e78b3c with identifier: 1815539 to the API
2025-12-04 08:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=1815539&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231815539&indx=63>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001815539-01989158-003.pdf',
 'color': 'White',
 'currency': 'GBP',
 'engine': '0.9L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a45157ed-0b57-550e-b71f-216ca1e78b3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'EA17OMF',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/RENAULT/CAPTUR?id=1815539',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'RENAULT',
 'model': 'CAPTUR',
 'odometer': 35301,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': 'Big Motoring World Ltd',
 'title': 'RENAULT CAPTUR 0.9 TCE 90 Dynamique S Nav 5dr',
 'transmission': 'manual',
 'trim': '0.9 TCE 90 Dynamique S Nav 5dr',
 'year': 2017}
2025-12-04 08:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271815539%27 HTTP/1.1" 200 None
2025-12-04 08:05:09 [manheim.gb] INFO: Saving data for 1815539: {'auction_closing_time': 1764838800.0, 'created_time': 1764741997.038529, 'last_price_update_time': 1764835509.228306}
2025-12-04 08:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1815539') HTTP/1.1" 204 0
2025-12-04 08:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=1835329&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231835329&indx=64> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d4df0fa-98da-5d45-bc17-84c3ed423fbe with identifier: 1835329
2025-12-04 08:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d4df0fa-98da-5d45-bc17-84c3ed423fbe with scrape type 2
2025-12-04 08:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d4df0fa-98da-5d45-bc17-84c3ed423fbe with scrape type 2
2025-12-04 08:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: 1d4df0fa-98da-5d45-bc17-84c3ed423fbe, identifier: 1835329
2025-12-04 08:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: 1d4df0fa-98da-5d45-bc17-84c3ed423fbe with identifier: 1835329
2025-12-04 08:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: 1d4df0fa-98da-5d45-bc17-84c3ed423fbe with identifier: 1835329
2025-12-04 08:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: manheim.gb, Posting item: 1d4df0fa-98da-5d45-bc17-84c3ed423fbe with identifier: 1835329 to the API
2025-12-04 08:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 08:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 08:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=1835329&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231835329&indx=64>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001835329-01984636-003.pdf',
 'color': 'BLUE',
 'currency': 'GBP',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1d4df0fa-98da-5d45-bc17-84c3ed423fbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LF17KLP',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/PEUGEOT/108?id=1835329',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'PEUGEOT',
 'model': '108',
 'odometer': 75018,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-19',
 'seller_name': 'DIRECT HEALTHCARE COMPANY',
 'title': 'PEUGEOT 108 1.0 Active 3dr',
 'transmission': 'manual',
 'trim': '1.0 Active 3dr',
 'year': 2017}
2025-12-04 08:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271835329%27 HTTP/1.1" 200 None
2025-12-04 08:05:10 [manheim.gb] INFO: Saving data for 1835329: {'auction_closing_time': 1764838800.0, 'created_time': 1764584049.195568, 'last_price_update_time': 1764835510.692247}
2025-12-04 08:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1835329') HTTP/1.1" 204 0
2025-12-04 08:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1787313&returnUrl=%2Fsearch%3FPage%3D1%26PageSize%3D100%26VehicleType%255B0%255D%3DCar%26RegistrationYear.Start%3D2016%26OdometerMiles.End%3D124274%26IsKm%3DFalse%231787313&indx=61> (referer: https://www.manheim.co.uk/search/refine) ['zyte-api']
2025-12-04 08:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc78e621-a4b4-5607-ac35-f858f92c4c33 with identifier: 1787313
2025-12-04 08:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc78e621-a4b4-5607-ac35-f858f92c4c33 with scrape type 2
2025-12-04 08:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc78e621-a4b4-5607-ac35-f858f92c4c33 with scrape type 2
2025-12-04 08:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: manheim.gb, Processed item id: bc78e621-a4b4-5607-ac35-f858f92c4c33, identifier: 1787313
2025-12-04 08:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: manheim.gb, Translating item: bc78e621-a4b4-5607-ac35-f858f92c4c33 with identifier: 1787313
2025-12-04 08:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: manheim.gb, Applying rules to item: bc78e621-a4b4-5607-ac35-f858f92c4c33 with identifier: 1787313
2025-12-04 08:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
2025-12-04 08:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: bc78e621-a4b4-5607-ac35-f858f92c4c33 spider: manheim.gb
2025-12-04 08:05:12 [scrapy.core.scraper] INFO: Dropped: Spider: manheim.gb, Dropping listing: bc78e621-a4b4-5607-ac35-f858f92c4c33 due to rule: registration_date_old.json, error: 13 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    13
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'car_expert_report_source_url': 'http://ecr.manheim.co.uk/pdf/MOL-0001787313-01982150-003.pdf',
 'color': 'White',
 'currency': 'GBP',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T09:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'bc78e621-a4b4-5607-ac35-f858f92c4c33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VN62POU',
 'link_to_web_offer': 'https://www.manheim.co.uk/vehicle-detail/NISSAN/QASHQAI?id=1787313',
 'listing': 'auction',
 'location': 'Colchester',
 'make': 'NISSAN',
 'model': 'QASHQAI',
 'odometer': 91259,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-01',
 'seller_name': 'John Banks',
 'title': 'NISSAN QASHQAI 1.5 dCi [110] N-Tec+ 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi [110] N-Tec+ 5dr',
 'year': 2012}
2025-12-04 08:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%271787313%27 HTTP/1.1" 200 None
2025-12-04 08:05:12 [manheim.gb] INFO: Saving data for 1787313: {'auction_closing_time': 1764838800.0, 'created_time': 1764584115.380676, 'last_price_update_time': 1764835512.227466}
2025-12-04 08:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='1787313') HTTP/1.1" 204 0
2025-12-04 08:05:12 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-04 08:05:12 [manheim.gb] INFO: manheim.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0}
2025-12-04 08:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20RowKey%20eq%20%273566423%27 HTTP/1.1" 200 None
2025-12-04 08:05:12 [manheim.gb] INFO: Saving data for 3566423: {'created_time': 1764835512.357277}
2025-12-04 08:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='manheim.gb',RowKey='3566423') HTTP/1.1" 204 0
2025-12-04 08:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 08:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27manheim.gb%27%20and%20last_price_update_time%20lt%201764403512 HTTP/1.1" 200 None
2025-12-04 08:05:12 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (28 items) in: file:///var/lib/scrapyd/items/sourcing_v2/manheim.gb/task_37_2025-12-04T08_00_02.jl
2025-12-04 08:05:12 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 220052,
 'downloader/request_count': 152,
 'downloader/request_method_count/GET': 149,
 'downloader/request_method_count/POST': 3,
 'downloader/response_bytes': 53941320,
 'downloader/response_count': 152,
 'downloader/response_status_count/200': 152,
 'elapsed_time_seconds': 291.700973,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 4, 8, 5, 12, 422426, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 34,
 'item_dropped_reasons_count/DropItem': 34,
 'item_scraped_count': 28,
 'log_count/DEBUG': 2066,
 'log_count/ERROR': 12,
 'log_count/INFO': 1877,
 'memusage/max': 195366912,
 'memusage/startup': 127275008,
 'photo_download_count': 80,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 85,
 'playwright/request_count/aborted': 47,
 'playwright/request_count/method/GET': 82,
 'playwright/request_count/method/POST': 3,
 'playwright/request_count/navigation': 4,
 'playwright/request_count/resource_type/document': 4,
 'playwright/request_count/resource_type/font': 8,
 'playwright/request_count/resource_type/image': 41,
 'playwright/request_count/resource_type/script': 22,
 'playwright/request_count/resource_type/stylesheet': 8,
 'playwright/request_count/resource_type/xhr': 2,
 'playwright/response_count': 38,
 'playwright/response_count/method/GET': 35,
 'playwright/response_count/method/POST': 3,
 'playwright/response_count/resource_type/document': 4,
 'playwright/response_count/resource_type/font': 8,
 'playwright/response_count/resource_type/script': 16,
 'playwright/response_count/resource_type/stylesheet': 8,
 'playwright/response_count/resource_type/xhr': 2,
 'request_depth_max': 6,
 'response_received_count': 72,
 'scheduler/dequeued': 152,
 'scheduler/dequeued/memory': 152,
 'scheduler/enqueued': 152,
 'scheduler/enqueued/memory': 152,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 65,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 29.74718404080218,
 'scrapy-zyte-api/mean_response_seconds': 30.027054478093753,
 'scrapy-zyte-api/processed': 65,
 'scrapy-zyte-api/request_args/actions': 62,
 'scrapy-zyte-api/request_args/browserHtml': 62,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 3,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 65,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 65,
 'scrapy-zyte-api/request_args/httpRequestBody': 3,
 'scrapy-zyte-api/request_args/httpRequestMethod': 3,
 'scrapy-zyte-api/request_args/httpResponseBody': 3,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 3,
 'scrapy-zyte-api/request_args/requestHeaders': 62,
 'scrapy-zyte-api/request_args/sessionContext': 62,
 'scrapy-zyte-api/request_args/url': 65,
 'scrapy-zyte-api/status_codes/200': 65,
 'scrapy-zyte-api/success': 65,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'spider_exceptions/ValueError': 1,
 'start_time': datetime.datetime(2025, 12, 4, 8, 0, 20, 721453, tzinfo=datetime.timezone.utc)}
2025-12-04 08:05:12 [scrapy.core.engine] INFO: Spider closed (finished)